Nov 08 21:29:43 user nova-compute[75993]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75993) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75993) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75993) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 08 21:29:43 user nova-compute[75993]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:29:43 user nova-compute[75993]: INFO nova.virt.driver [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 08 21:29:43 user nova-compute[75993]: INFO nova.compute.provider_config [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] Acquiring lock "singleton_lock" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] Acquired lock "singleton_lock" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] Releasing lock "singleton_lock" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] Full set of CONF: {{(pid=75993) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ******************************************************************************** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] Configuration options gathered from: {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ================================================================================ {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] allow_resize_to_same_host      = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] arq_binding_timeout            = 300 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] backdoor_port                  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] backdoor_socket                = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] block_device_allocate_retries  = 300 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] block_device_allocate_retries_interval = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cert                           = self.pem {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute_monitors               = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] config_dir                     = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] config_drive_format            = iso9660 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] config_source                  = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] console_host                   = user {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] control_exchange               = nova {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cpu_allocation_ratio           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] daemon                         = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] debug                          = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] default_access_ip_network_name = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] default_availability_zone      = nova {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] default_ephemeral_format       = ext4 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] default_green_pool_size        = 1000 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] default_schedule_zone          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] disk_allocation_ratio          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] enable_new_services            = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] enabled_ssl_apis               = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] flat_injected                  = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] force_config_drive             = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] force_raw_images               = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] graceful_shutdown_timeout      = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] heal_instance_info_cache_interval = 60 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] host                           = user {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] instance_build_timeout         = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] instance_delete_interval       = 300 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] instance_name_template         = instance-%08x {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] instance_usage_audit           = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] instance_usage_audit_period    = month {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] internal_service_availability_zone = internal {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] key                            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] live_migration_retry_count     = 30 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] log_config_append              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] log_dir                        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] log_file                       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] log_options                    = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] log_rotate_interval            = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] log_rotate_interval_type       = days {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] log_rotation_type              = none {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] long_rpc_timeout               = 1800 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] max_concurrent_builds          = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] max_concurrent_live_migrations = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] max_concurrent_snapshots       = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] max_local_block_devices        = 3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] max_logfile_count              = 30 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] max_logfile_size_mb            = 200 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] maximum_instance_delete_attempts = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] metadata_listen                = 0.0.0.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] metadata_listen_port           = 8775 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] metadata_workers               = 3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] migrate_max_retries            = -1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] mkisofs_cmd                    = genisoimage {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] my_ip                          = 10.0.0.210 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] network_allocate_retries       = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] osapi_compute_listen_port      = 8774 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] osapi_compute_unique_server_name_scope =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] osapi_compute_workers          = 3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] password_length                = 12 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] periodic_enable                = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] periodic_fuzzy_delay           = 60 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] pointer_model                  = ps2mouse {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] preallocate_images             = none {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] publish_errors                 = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] pybasedir                      = /opt/stack/nova {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ram_allocation_ratio           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] rate_limit_burst               = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] rate_limit_except_level        = CRITICAL {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] rate_limit_interval            = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] reboot_timeout                 = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] reclaim_instance_interval      = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] record                         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] reimage_timeout_per_gb         = 60 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] report_interval                = 120 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] rescue_timeout                 = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] reserved_host_cpus             = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] reserved_host_disk_mb          = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] reserved_host_memory_mb        = 512 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] reserved_huge_pages            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] resize_confirm_window          = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] resize_fs_using_block_device   = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] resume_guests_state_on_host_boot = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] rpc_response_timeout           = 60 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] run_external_periodic_tasks    = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] running_deleted_instance_action = reap {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] running_deleted_instance_timeout = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] scheduler_instance_sync_interval = 120 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] service_down_time              = 720 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] servicegroup_driver            = db {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] shelved_offload_time           = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] shelved_poll_interval          = 3600 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] shutdown_timeout               = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] source_is_ipv6                 = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ssl_only                       = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] state_path                     = /opt/stack/data/nova {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] sync_power_state_interval      = 600 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] sync_power_state_pool_size     = 1000 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] syslog_log_facility            = LOG_USER {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] tempdir                        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] timeout_nbd                    = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] transport_url                  = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] update_resources_interval      = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] use_cow_images                 = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] use_eventlog                   = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] use_journal                    = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] use_json                       = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] use_rootwrap_daemon            = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] use_stderr                     = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] use_syslog                     = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vcpu_pin_set                   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plugging_is_fatal          = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plugging_timeout           = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] virt_mkfs                      = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] volume_usage_poll_interval     = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] watch_log_file                 = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] web                            = /usr/share/spice-html5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_concurrency.disable_process_locking = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.auth_strategy              = keystone {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.compute_link_prefix        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.dhcp_domain                = novalocal {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.enable_instance_password   = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.glance_link_prefix         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.instance_list_per_project_cells = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.list_records_by_skipping_down_cells = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.local_metadata_per_cell    = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.max_limit                  = 1000 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.metadata_cache_expiration  = 15 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.neutron_default_tenant_id  = default {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.use_forwarded_for          = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.use_neutron_default_nets   = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.vendordata_dynamic_targets = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.vendordata_jsonfile_path   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.backend_argument         = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.config_prefix            = cache.oslo {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.dead_timeout             = 60.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.debug_cache_backend      = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.enable_retry_client      = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.enable_socket_keepalive  = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.enabled                  = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.expiration_time          = 600 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.hashclient_retry_attempts = 2 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.memcache_dead_retry      = 300 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.memcache_password        =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.memcache_sasl_enabled    = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.memcache_username        =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.proxies                  = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.retry_attempts           = 2 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.retry_delay              = 0.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.socket_keepalive_count   = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.socket_keepalive_idle    = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.socket_keepalive_interval = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.tls_allowed_ciphers      = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.tls_cafile               = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.tls_certfile             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.tls_enabled              = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cache.tls_keyfile              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.auth_section            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.auth_type               = password {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.cafile                  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.certfile                = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.collect_timing          = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.cross_az_attach         = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.debug                   = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.endpoint_template       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.http_retries            = 3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.insecure                = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.keyfile                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.os_region_name          = RegionOne {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.split_loggers           = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cinder.timeout                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.cpu_dedicated_set      = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.cpu_shared_set         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.image_type_exclude_list = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.resource_provider_association_refresh = 300 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.shutdown_retry_interval = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] conductor.workers              = 3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] console.allowed_origins        = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] console.ssl_ciphers            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] console.ssl_minimum_version    = default {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] consoleauth.token_ttl          = 600 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.cafile                  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.certfile                = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.collect_timing          = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.connect_retries         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.connect_retry_delay     = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.endpoint_override       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.insecure                = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.keyfile                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.max_version             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.min_version             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.region_name             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.service_name            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.service_type            = accelerator {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.split_loggers           = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.status_code_retries     = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.status_code_retry_delay = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.timeout                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] cyborg.version                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.backend               = sqlalchemy {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.connection            = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.connection_debug      = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.connection_parameters =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.connection_recycle_time = 3600 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.connection_trace      = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.db_inc_retry_interval = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.db_max_retries        = 20 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.db_max_retry_interval = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.db_retry_interval     = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.max_overflow          = 50 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.max_pool_size         = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.max_retries           = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.mysql_wsrep_sync_wait = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.pool_timeout          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.retry_interval        = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.slave_connection      = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] database.sqlite_synchronous    = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.backend           = sqlalchemy {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.connection        = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.connection_debug  = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.connection_parameters =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.connection_recycle_time = 3600 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.connection_trace  = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.db_inc_retry_interval = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.db_max_retries    = 20 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.db_max_retry_interval = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.db_retry_interval = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.max_overflow      = 50 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.max_pool_size     = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.max_retries       = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.pool_timeout      = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.retry_interval    = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.slave_connection  = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] api_database.sqlite_synchronous = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] devices.enabled_mdev_types     = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ephemeral_storage_encryption.enabled = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.api_servers             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.cafile                  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.certfile                = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.collect_timing          = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.connect_retries         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.connect_retry_delay     = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.debug                   = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.default_trusted_certificate_ids = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.enable_certificate_validation = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.enable_rbd_download     = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.endpoint_override       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.insecure                = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.keyfile                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.max_version             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.min_version             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.num_retries             = 3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.rbd_ceph_conf           =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.rbd_connect_timeout     = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.rbd_pool                =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.rbd_user                =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.region_name             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.service_name            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.service_type            = image {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.split_loggers           = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.status_code_retries     = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.status_code_retry_delay = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.timeout                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.verify_glance_signatures = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] glance.version                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] guestfs.debug                  = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.config_drive_cdrom      = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.config_drive_inject_password = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.enable_remotefx         = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.instances_path_share    =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.limit_cpu_features      = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.use_multipath_io        = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.vswitch_name            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] mks.enabled                    = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] image_cache.manager_interval   = 2400 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] image_cache.precache_concurrency = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] image_cache.remove_unused_base_images = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] image_cache.subdirectory_name  = _base {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.api_max_retries         = 60 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.api_retry_interval      = 2 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.auth_section            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.auth_type               = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.cafile                  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.certfile                = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.collect_timing          = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.conductor_group         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.connect_retries         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.connect_retry_delay     = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.endpoint_override       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.insecure                = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.keyfile                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.max_version             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.min_version             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.peer_list               = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.region_name             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.serial_console_state_timeout = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.service_name            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.service_type            = baremetal {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.split_loggers           = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.status_code_retries     = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.status_code_retry_delay = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.timeout                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ironic.version                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] key_manager.fixed_key          = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.barbican_api_version  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.barbican_endpoint     = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.barbican_endpoint_type = public {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.barbican_region_name  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.cafile                = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.certfile              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.collect_timing        = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.insecure              = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.keyfile               = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.number_of_retries     = 60 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.retry_delay           = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.send_service_user_token = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.split_loggers         = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.timeout               = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.verify_ssl            = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican.verify_ssl_path       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican_service_user.auth_section = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican_service_user.auth_type = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican_service_user.cafile   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican_service_user.certfile = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican_service_user.collect_timing = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican_service_user.insecure = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican_service_user.keyfile  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican_service_user.split_loggers = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] barbican_service_user.timeout  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.approle_role_id          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.approle_secret_id        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.cafile                   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.certfile                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.collect_timing           = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.insecure                 = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.keyfile                  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.kv_mountpoint            = secret {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.kv_path                  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.kv_version               = 2 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.namespace                = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.root_token_id            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.split_loggers            = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.ssl_ca_crt_file          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.timeout                  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.use_ssl                  = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.auth_section          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.auth_type             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.cafile                = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.certfile              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.collect_timing        = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.connect_retries       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.connect_retry_delay   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.endpoint_override     = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.insecure              = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.keyfile               = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.max_version           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.min_version           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.region_name           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.service_name          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.service_type          = identity {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.split_loggers         = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.status_code_retries   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.status_code_retry_delay = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.timeout               = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] keystone.version               = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.connection_uri         =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.cpu_mode               = custom {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: WARNING oslo_config.cfg [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.cpu_power_governor_high = performance {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.cpu_power_management   = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.device_detach_attempts = 8 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.device_detach_timeout  = 20 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.disk_cachemodes        = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.disk_prefix            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.enabled_perf_events    = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.file_backed_memory     = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.gid_maps               = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.hw_disk_discard        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.hw_machine_type        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.images_rbd_pool        = rbd {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.images_type            = default {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.images_volume_group    = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.inject_key             = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.inject_partition       = -2 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.inject_password        = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.iscsi_iface            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.iser_use_multipath     = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_downtime = 500 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_inbound_addr = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_scheme  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_timeout_action = abort {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_tunnelled = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: WARNING oslo_config.cfg [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 08 21:29:43 user nova-compute[75993]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 08 21:29:43 user nova-compute[75993]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 08 21:29:43 user nova-compute[75993]: and ``live_migration_inbound_addr`` respectively.
Nov 08 21:29:43 user nova-compute[75993]: ).  Its value may be silently ignored in the future.
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.live_migration_with_native_tls = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.max_queues             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.nfs_mount_options      = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.num_pcie_ports         = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.pmem_namespaces        = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.quobyte_client_cfg     = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.rbd_secret_uuid        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.rbd_user               = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.rescue_image_id        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.rescue_kernel_id       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.rx_queue_size          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.smbfs_mount_options    =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.snapshot_compression   = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:43 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.snapshot_image_format  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.sparse_logical_volumes = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.swtpm_enabled          = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.swtpm_group            = tss {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.swtpm_user             = tss {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.sysinfo_serial         = unique {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.tb_cache_size          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.tx_queue_size          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.uid_maps               = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.use_virtio_for_bridges = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.virt_type              = kvm {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.volume_clear           = zero {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.volume_clear_size      = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.volume_use_multipath   = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.vzstorage_cache_path   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.auth_section           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.auth_type              = password {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.cafile                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.certfile               = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.collect_timing         = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.connect_retries        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.connect_retry_delay    = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.default_floating_pool  = public {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.endpoint_override      = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.extension_sync_interval = 600 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.http_retries           = 3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.insecure               = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.keyfile                = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.max_version            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.min_version            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.ovs_bridge             = br-int {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.physnets               = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.region_name            = RegionOne {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.service_metadata_proxy = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.service_name           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.service_type           = network {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.split_loggers          = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.status_code_retries    = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.status_code_retry_delay = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.timeout                = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] neutron.version                = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] notifications.bdms_in_notifications = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] notifications.default_level    = INFO {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] notifications.notification_format = unversioned {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] notifications.notify_on_state_change = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] pci.alias                      = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] pci.device_spec                = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] pci.report_in_placement        = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.auth_section         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.auth_type            = password {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.cafile               = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.certfile             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.collect_timing       = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.connect_retries      = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.connect_retry_delay  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.default_domain_id    = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.default_domain_name  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.domain_id            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.domain_name          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.endpoint_override    = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.insecure             = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.keyfile              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.max_version          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.min_version          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.password             = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.project_domain_id    = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.project_domain_name  = Default {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.project_id           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.project_name         = service {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.region_name          = RegionOne {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.service_name         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.service_type         = placement {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.split_loggers        = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.status_code_retries  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.status_code_retry_delay = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.system_scope         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.timeout              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.trust_id             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.user_domain_id       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.user_domain_name     = Default {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.user_id              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.username             = placement {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] placement.version              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.cores                    = 20 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.count_usage_from_placement = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.injected_file_content_bytes = 10240 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.injected_file_path_length = 255 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.injected_files           = 5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.instances                = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.key_pairs                = 100 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.metadata_items           = 128 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.ram                      = 51200 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.recheck_quota            = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.server_group_members     = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] quota.server_groups            = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] rdp.enabled                    = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] scheduler.image_metadata_prefilter = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] scheduler.max_attempts         = 3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] scheduler.max_placement_results = 1000 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] scheduler.workers              = 3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.host_subset_size = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.isolated_hosts = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.isolated_images = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.pci_in_placement = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.track_instance_changes = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] metrics.required               = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] metrics.weight_multiplier      = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] metrics.weight_setting         = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] serial_console.enabled         = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] serial_console.port_range      = 10000:20000 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] serial_console.serialproxy_port = 6083 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] service_user.auth_section      = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] service_user.auth_type         = password {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] service_user.cafile            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] service_user.certfile          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] service_user.collect_timing    = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] service_user.insecure          = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] service_user.keyfile           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] service_user.send_service_user_token = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] service_user.split_loggers     = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] service_user.timeout           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.agent_enabled            = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.enabled                  = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.html5proxy_port          = 6082 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.image_compression        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.jpeg_compression         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.playback_compression     = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.server_listen            = 127.0.0.1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.streaming_mode           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] spice.zlib_compression         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] upgrade_levels.baseapi         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] upgrade_levels.cert            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] upgrade_levels.compute         = auto {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] upgrade_levels.conductor       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] upgrade_levels.scheduler       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vendordata_dynamic_auth.cafile = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vendordata_dynamic_auth.certfile = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vendordata_dynamic_auth.insecure = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vendordata_dynamic_auth.timeout = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.api_retry_count         = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.ca_file                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.cache_prefix            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.cluster_name            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.connection_pool_size    = 10 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.console_delay_seconds   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.datastore_regex         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.host_ip                 = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.host_password           = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.host_port               = 443 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.host_username           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.insecure                = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.integration_bridge      = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.maximum_objects         = 100 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.pbm_default_policy      = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.pbm_enabled             = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.pbm_wsdl_location       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.serial_port_proxy_uri   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.serial_port_service_uri = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.task_poll_interval      = 0.5 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.use_linked_clone        = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.vnc_keymap              = en-us {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.vnc_port                = 5900 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vmware.vnc_port_total          = 10000 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vnc.auth_schemes               = ['none'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vnc.enabled                    = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vnc.novncproxy_port            = 6080 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vnc.vencrypt_ca_certs          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vnc.vencrypt_client_cert       = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vnc.vencrypt_client_key        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.disable_rootwrap   = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.enable_numa_live_migration = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.libvirt_disable_apic = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] wsgi.client_socket_timeout     = 900 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] wsgi.default_pool_size         = 1000 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] wsgi.keep_alive                = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] wsgi.max_header_line           = 16384 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] wsgi.ssl_ca_file               = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] wsgi.ssl_cert_file             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] wsgi.ssl_key_file              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] wsgi.tcp_keepidle              = 600 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] zvm.ca_file                    = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] zvm.cloud_connector_url        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] zvm.reachable_timeout          = 300 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_policy.enforce_new_defaults = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_policy.enforce_scope      = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_policy.policy_default_rule = default {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler.connection_string     = messaging:// {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler.enabled               = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler.es_doc_type           = notification {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler.es_scroll_size        = 10000 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler.es_scroll_time        = 2m {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler.filter_error_trace    = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler.hmac_keys             = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler.sentinel_service_name = mymaster {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler.socket_timeout        = 0.1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler.trace_requests        = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler.trace_sqlalchemy      = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler_jaeger.process_tags   = {} {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler_jaeger.service_name_prefix = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] profiler_otlp.service_name_prefix = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] remote_debug.host              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] remote_debug.port              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_notifications.retry = -1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.auth_section        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.auth_type           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.cafile              = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.certfile            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.collect_timing      = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.connect_retries     = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.connect_retry_delay = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.endpoint_id         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.endpoint_override   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.insecure            = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.keyfile             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.max_version         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.min_version         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.region_name         = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.service_name        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.service_type        = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.split_loggers       = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.status_code_retries = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.status_code_retry_delay = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.timeout             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.valid_interfaces    = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_limit.version             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_reports.file_event_handler = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] oslo_reports.log_dir           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_ovs_privileged.group  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] vif_plug_ovs_privileged.user   = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_ovs.isolate_vif         = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] os_brick.lock_path             = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] privsep_osbrick.capabilities   = [21] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] privsep_osbrick.group          = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] privsep_osbrick.helper_command = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] privsep_osbrick.user           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] nova_sys_admin.group           = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] nova_sys_admin.helper_command  = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] nova_sys_admin.user            = None {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG oslo_service.service [None req-8a347cd8-061c-43ed-97c1-3dc68224dc46 None None] ******************************************************************************** {{(pid=75993) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 08 21:29:44 user nova-compute[75993]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 08 21:29:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Connecting to libvirt: qemu:///system {{(pid=75993) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f858c3ef040> {{(pid=75993) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 08 21:29:44 user nova-compute[75993]: libvirt:  error : internal error: could not initialize domain event timer
Nov 08 21:29:44 user nova-compute[75993]: WARNING nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 08 21:29:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f858c3ef040> {{(pid=75993) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Starting native event thread {{(pid=75993) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Starting green dispatch thread {{(pid=75993) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 08 21:29:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Starting connection event dispatch thread {{(pid=75993) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 08 21:29:44 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Connection event '1' reason 'None'
Nov 08 21:29:44 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 21:29:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.mount [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Initialising _HostMountState generation 0 {{(pid=75993) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 08 21:29:51 user nova-compute[75993]: INFO nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Libvirt host capabilities <capabilities>
Nov 08 21:29:51 user nova-compute[75993]:   <host>
Nov 08 21:29:51 user nova-compute[75993]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 08 21:29:51 user nova-compute[75993]:     <cpu>
Nov 08 21:29:51 user nova-compute[75993]:       <arch>x86_64</arch>
Nov 08 21:29:51 user nova-compute[75993]:       <model>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <vendor>Intel</vendor>
Nov 08 21:29:51 user nova-compute[75993]:       <microcode version='1070'/>
Nov 08 21:29:51 user nova-compute[75993]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 08 21:29:51 user nova-compute[75993]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='ss'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='vmx'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='pcid'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='osxsave'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='hypervisor'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='arat'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='tsc_adjust'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='md-clear'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='arch-capabilities'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='invtsc'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='rsba'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature name='skip-l1dfl-vmentry'/>
Nov 08 21:29:51 user nova-compute[75993]:       <pages unit='KiB' size='4'/>
Nov 08 21:29:51 user nova-compute[75993]:       <pages unit='KiB' size='2048'/>
Nov 08 21:29:51 user nova-compute[75993]:     </cpu>
Nov 08 21:29:51 user nova-compute[75993]:     <power_management>
Nov 08 21:29:51 user nova-compute[75993]:       <suspend_mem/>
Nov 08 21:29:51 user nova-compute[75993]:       <suspend_disk/>
Nov 08 21:29:51 user nova-compute[75993]:       <suspend_hybrid/>
Nov 08 21:29:51 user nova-compute[75993]:     </power_management>
Nov 08 21:29:51 user nova-compute[75993]:     <iommu support='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     <migration_features>
Nov 08 21:29:51 user nova-compute[75993]:       <live/>
Nov 08 21:29:51 user nova-compute[75993]:       <uri_transports>
Nov 08 21:29:51 user nova-compute[75993]:         <uri_transport>tcp</uri_transport>
Nov 08 21:29:51 user nova-compute[75993]:         <uri_transport>rdma</uri_transport>
Nov 08 21:29:51 user nova-compute[75993]:       </uri_transports>
Nov 08 21:29:51 user nova-compute[75993]:     </migration_features>
Nov 08 21:29:51 user nova-compute[75993]:     <topology>
Nov 08 21:29:51 user nova-compute[75993]:       <cells num='2'>
Nov 08 21:29:51 user nova-compute[75993]:         <cell id='0'>
Nov 08 21:29:51 user nova-compute[75993]:           <memory unit='KiB'>8189224</memory>
Nov 08 21:29:51 user nova-compute[75993]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 08 21:29:51 user nova-compute[75993]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 21:29:51 user nova-compute[75993]:           <distances>
Nov 08 21:29:51 user nova-compute[75993]:             <sibling id='0' value='10'/>
Nov 08 21:29:51 user nova-compute[75993]:             <sibling id='1' value='20'/>
Nov 08 21:29:51 user nova-compute[75993]:           </distances>
Nov 08 21:29:51 user nova-compute[75993]:           <cpus num='6'>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 08 21:29:51 user nova-compute[75993]:           </cpus>
Nov 08 21:29:51 user nova-compute[75993]:         </cell>
Nov 08 21:29:51 user nova-compute[75993]:         <cell id='1'>
Nov 08 21:29:51 user nova-compute[75993]:           <memory unit='KiB'>8206460</memory>
Nov 08 21:29:51 user nova-compute[75993]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 08 21:29:51 user nova-compute[75993]:           <pages unit='KiB' size='2048'>0</pages>
Nov 08 21:29:51 user nova-compute[75993]:           <distances>
Nov 08 21:29:51 user nova-compute[75993]:             <sibling id='0' value='20'/>
Nov 08 21:29:51 user nova-compute[75993]:             <sibling id='1' value='10'/>
Nov 08 21:29:51 user nova-compute[75993]:           </distances>
Nov 08 21:29:51 user nova-compute[75993]:           <cpus num='6'>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 08 21:29:51 user nova-compute[75993]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 08 21:29:51 user nova-compute[75993]:           </cpus>
Nov 08 21:29:51 user nova-compute[75993]:         </cell>
Nov 08 21:29:51 user nova-compute[75993]:       </cells>
Nov 08 21:29:51 user nova-compute[75993]:     </topology>
Nov 08 21:29:51 user nova-compute[75993]:     <cache>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 08 21:29:51 user nova-compute[75993]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 08 21:29:51 user nova-compute[75993]:     </cache>
Nov 08 21:29:51 user nova-compute[75993]:     <secmodel>
Nov 08 21:29:51 user nova-compute[75993]:       <model>apparmor</model>
Nov 08 21:29:51 user nova-compute[75993]:       <doi>0</doi>
Nov 08 21:29:51 user nova-compute[75993]:     </secmodel>
Nov 08 21:29:51 user nova-compute[75993]:     <secmodel>
Nov 08 21:29:51 user nova-compute[75993]:       <model>dac</model>
Nov 08 21:29:51 user nova-compute[75993]:       <doi>0</doi>
Nov 08 21:29:51 user nova-compute[75993]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 08 21:29:51 user nova-compute[75993]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 08 21:29:51 user nova-compute[75993]:     </secmodel>
Nov 08 21:29:51 user nova-compute[75993]:   </host>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='alpha'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>64</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>clipper</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='armv6l'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>spitz</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>nuri</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>kzm</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sx1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>z2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>tosa</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>n810</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>n800</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>terrier</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>midway</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>microbit</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>verdex</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>highbank</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>akita</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>connex</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>collie</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='armv7l'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>spitz</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>nuri</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>kzm</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sx1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>z2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>tosa</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>n810</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>n800</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>terrier</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>midway</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>microbit</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>verdex</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>highbank</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>akita</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>connex</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>collie</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='aarch64'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>64</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>integratorcp</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>borzoi</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>spitz</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>nuri</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>musca-b1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>versatileab</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>kzm</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>musca-a</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>smdkc210</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sx1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>z2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>tosa</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>sabrelite</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>realview-eb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>n810</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>n800</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>versatilepb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>terrier</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mainstone</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>midway</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>musicpal</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>microbit</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>cubieboard</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>verdex</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>netduino2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>raspi3b</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>raspi2b</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>cheetah</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>highbank</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>akita</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>connex</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>collie</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>raspi0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <acpi default='on' toggle='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='cris'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='i686'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>isapc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>microvm</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='kvm'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <pae/>
Nov 08 21:29:51 user nova-compute[75993]:       <nonpae/>
Nov 08 21:29:51 user nova-compute[75993]:       <acpi default='on' toggle='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:       <apic default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='m68k'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>an5206</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>q800</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>next-cube</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='microblaze'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='microblazeel'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='mips'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='16'>malta</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='mipsel'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='16'>malta</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='mips64'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>64</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='16'>malta</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>pica61</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>magnum</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='mips64el'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>64</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='16'>malta</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mipssim</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>pica61</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>magnum</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='16'>boston</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='ppc'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mac99</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>40p</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>taihu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='ppc64'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>64</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>taihu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>40p</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mac99</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='ppc64le'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>64</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2048'>powernv9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>taihu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2048'>powernv10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>ppce500</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>40p</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>pegasos2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>bamboo</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>g3beige</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>mac99</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sam460ex</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>ref405ep</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2048'>powernv8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='riscv32'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='8'>spike</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>opentitan</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='8'>virt</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='riscv64'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>64</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='8'>spike</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='5'>sifive_u</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>shakti_c</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sifive_e</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='8'>virt</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='s390x'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>64</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='sh4'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>shix</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>r2d</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='sh4eb'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>64</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>shix</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>r2d</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='sparc'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>SS-5</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>SS-20</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>LX</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>SS-4</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>SS-10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>Voyager</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='sparc64'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>64</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sun4u</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>niagara</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>sun4v</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='x86_64'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>64</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>x-remote</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='1'>isapc</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>microvm</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='kvm'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <acpi default='on' toggle='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:       <apic default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='xtensa'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>sim</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>kc705</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>ml605</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>virt</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>lx200</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>lx60</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]:   <guest>
Nov 08 21:29:51 user nova-compute[75993]:     <os_type>hvm</os_type>
Nov 08 21:29:51 user nova-compute[75993]:     <arch name='xtensaeb'>
Nov 08 21:29:51 user nova-compute[75993]:       <wordsize>32</wordsize>
Nov 08 21:29:51 user nova-compute[75993]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='4'>sim</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>kc705</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>ml605</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>virt</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>lx200</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>lx60</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 08 21:29:51 user nova-compute[75993]:       <domain type='qemu'/>
Nov 08 21:29:51 user nova-compute[75993]:     </arch>
Nov 08 21:29:51 user nova-compute[75993]:     <features>
Nov 08 21:29:51 user nova-compute[75993]:       <cpuselection/>
Nov 08 21:29:51 user nova-compute[75993]:       <deviceboot/>
Nov 08 21:29:51 user nova-compute[75993]:       <disksnapshot default='on' toggle='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     </features>
Nov 08 21:29:51 user nova-compute[75993]:   </guest>
Nov 08 21:29:51 user nova-compute[75993]: </capabilities>
Nov 08 21:29:51 user nova-compute[75993]: 
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 08 21:29:51 user nova-compute[75993]: <domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 21:29:51 user nova-compute[75993]:   <domain>kvm</domain>
Nov 08 21:29:51 user nova-compute[75993]:   <machine>pc-i440fx-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:   <arch>i686</arch>
Nov 08 21:29:51 user nova-compute[75993]:   <vcpu max='255'/>
Nov 08 21:29:51 user nova-compute[75993]:   <iothreads supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:   <os supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='firmware'/>
Nov 08 21:29:51 user nova-compute[75993]:     <loader supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>rom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pflash</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='readonly'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>yes</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='secure'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </loader>
Nov 08 21:29:51 user nova-compute[75993]:   </os>
Nov 08 21:29:51 user nova-compute[75993]:   <cpu>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-passthrough' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='hostPassthroughMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='maximum' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='maximumMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-model' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <vendor>Intel</vendor>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ss'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='vmx'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pcid'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='hypervisor'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arat'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='umip'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='md-clear'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibpb'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibrs'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='erms'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='lm'/>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='custom' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>qemu64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>qemu32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>phenom</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>n270</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>kvm64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>coreduo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>core2duo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>athlon</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Westmere</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Snowridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Penryn</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G5</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G4</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G1</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Nehalem</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Rome</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Milan</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Dhyana</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cooperlake</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Conroe</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>486</model>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:   </cpu>
Nov 08 21:29:51 user nova-compute[75993]:   <memoryBacking supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='sourceType'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>file</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>anonymous</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>memfd</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:   </memoryBacking>
Nov 08 21:29:51 user nova-compute[75993]:   <devices>
Nov 08 21:29:51 user nova-compute[75993]:     <disk supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='diskDevice'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>disk</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cdrom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>floppy</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>lun</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='bus'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ide</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>fdc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sata</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </disk>
Nov 08 21:29:51 user nova-compute[75993]:     <graphics supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sdl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vnc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>spice</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egl-headless</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </graphics>
Nov 08 21:29:51 user nova-compute[75993]:     <video supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='modelType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cirrus</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vmvga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>qxl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>none</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>bochs</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ramfb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </video>
Nov 08 21:29:51 user nova-compute[75993]:     <hostdev supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='mode'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>subsystem</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='startupPolicy'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>default</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>mandatory</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>requisite</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>optional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='subsysType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pci</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='capsType'/>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='pciBackend'/>
Nov 08 21:29:51 user nova-compute[75993]:     </hostdev>
Nov 08 21:29:51 user nova-compute[75993]:     <rng supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>random</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egd</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>builtin</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </rng>
Nov 08 21:29:51 user nova-compute[75993]:     <filesystem supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='driverType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>path</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>handle</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtiofs</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </filesystem>
Nov 08 21:29:51 user nova-compute[75993]:     <tpm supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-tis</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-crb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>passthrough</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>emulator</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </tpm>
Nov 08 21:29:51 user nova-compute[75993]:   </devices>
Nov 08 21:29:51 user nova-compute[75993]:   <features>
Nov 08 21:29:51 user nova-compute[75993]:     <gic supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     <vmcoreinfo supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <genid supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backingStoreInput supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backup supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <sev supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:   </features>
Nov 08 21:29:51 user nova-compute[75993]: </domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:  {{(pid=75993) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 08 21:29:51 user nova-compute[75993]: <domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 21:29:51 user nova-compute[75993]:   <domain>kvm</domain>
Nov 08 21:29:51 user nova-compute[75993]:   <machine>pc-q35-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:   <arch>i686</arch>
Nov 08 21:29:51 user nova-compute[75993]:   <vcpu max='288'/>
Nov 08 21:29:51 user nova-compute[75993]:   <iothreads supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:   <os supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='firmware'/>
Nov 08 21:29:51 user nova-compute[75993]:     <loader supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>rom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pflash</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='readonly'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>yes</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='secure'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </loader>
Nov 08 21:29:51 user nova-compute[75993]:   </os>
Nov 08 21:29:51 user nova-compute[75993]:   <cpu>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-passthrough' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='hostPassthroughMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='maximum' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='maximumMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-model' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <vendor>Intel</vendor>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ss'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='vmx'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pcid'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='hypervisor'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arat'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='umip'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='md-clear'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibpb'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibrs'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='erms'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='lm'/>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='custom' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>qemu64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>qemu32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>phenom</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>n270</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>kvm64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>coreduo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>core2duo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>athlon</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Westmere</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Snowridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Penryn</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G5</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G4</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G1</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Nehalem</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Rome</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Milan</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Dhyana</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cooperlake</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Conroe</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>486</model>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:   </cpu>
Nov 08 21:29:51 user nova-compute[75993]:   <memoryBacking supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='sourceType'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>file</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>anonymous</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>memfd</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:   </memoryBacking>
Nov 08 21:29:51 user nova-compute[75993]:   <devices>
Nov 08 21:29:51 user nova-compute[75993]:     <disk supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='diskDevice'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>disk</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cdrom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>floppy</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>lun</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='bus'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>fdc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sata</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </disk>
Nov 08 21:29:51 user nova-compute[75993]:     <graphics supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sdl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vnc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>spice</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egl-headless</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </graphics>
Nov 08 21:29:51 user nova-compute[75993]:     <video supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='modelType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cirrus</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vmvga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>qxl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>none</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>bochs</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ramfb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </video>
Nov 08 21:29:51 user nova-compute[75993]:     <hostdev supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='mode'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>subsystem</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='startupPolicy'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>default</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>mandatory</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>requisite</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>optional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='subsysType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pci</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='capsType'/>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='pciBackend'/>
Nov 08 21:29:51 user nova-compute[75993]:     </hostdev>
Nov 08 21:29:51 user nova-compute[75993]:     <rng supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>random</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egd</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>builtin</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </rng>
Nov 08 21:29:51 user nova-compute[75993]:     <filesystem supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='driverType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>path</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>handle</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtiofs</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </filesystem>
Nov 08 21:29:51 user nova-compute[75993]:     <tpm supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-tis</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-crb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>passthrough</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>emulator</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </tpm>
Nov 08 21:29:51 user nova-compute[75993]:   </devices>
Nov 08 21:29:51 user nova-compute[75993]:   <features>
Nov 08 21:29:51 user nova-compute[75993]:     <gic supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     <vmcoreinfo supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <genid supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backingStoreInput supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backup supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <sev supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:   </features>
Nov 08 21:29:51 user nova-compute[75993]: </domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:  {{(pid=75993) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 08 21:29:51 user nova-compute[75993]: <domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 21:29:51 user nova-compute[75993]:   <domain>kvm</domain>
Nov 08 21:29:51 user nova-compute[75993]:   <machine>pc-i440fx-jammy</machine>
Nov 08 21:29:51 user nova-compute[75993]:   <arch>i686</arch>
Nov 08 21:29:51 user nova-compute[75993]:   <vcpu max='255'/>
Nov 08 21:29:51 user nova-compute[75993]:   <iothreads supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:   <os supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='firmware'/>
Nov 08 21:29:51 user nova-compute[75993]:     <loader supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>rom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pflash</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='readonly'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>yes</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='secure'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </loader>
Nov 08 21:29:51 user nova-compute[75993]:   </os>
Nov 08 21:29:51 user nova-compute[75993]:   <cpu>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-passthrough' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='hostPassthroughMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='maximum' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='maximumMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-model' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <vendor>Intel</vendor>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ss'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='vmx'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pcid'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='hypervisor'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arat'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='umip'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='md-clear'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibpb'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibrs'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='erms'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='lm'/>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='custom' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>qemu64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>qemu32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>phenom</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>n270</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>kvm64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>coreduo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>core2duo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>athlon</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Westmere</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Snowridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Penryn</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G5</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G4</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G1</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Nehalem</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Rome</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Milan</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Dhyana</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cooperlake</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Conroe</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>486</model>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:   </cpu>
Nov 08 21:29:51 user nova-compute[75993]:   <memoryBacking supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='sourceType'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>file</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>anonymous</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>memfd</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:   </memoryBacking>
Nov 08 21:29:51 user nova-compute[75993]:   <devices>
Nov 08 21:29:51 user nova-compute[75993]:     <disk supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='diskDevice'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>disk</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cdrom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>floppy</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>lun</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='bus'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ide</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>fdc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sata</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </disk>
Nov 08 21:29:51 user nova-compute[75993]:     <graphics supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sdl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vnc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>spice</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egl-headless</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </graphics>
Nov 08 21:29:51 user nova-compute[75993]:     <video supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='modelType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cirrus</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vmvga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>qxl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>none</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>bochs</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ramfb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </video>
Nov 08 21:29:51 user nova-compute[75993]:     <hostdev supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='mode'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>subsystem</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='startupPolicy'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>default</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>mandatory</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>requisite</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>optional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='subsysType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pci</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='capsType'/>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='pciBackend'/>
Nov 08 21:29:51 user nova-compute[75993]:     </hostdev>
Nov 08 21:29:51 user nova-compute[75993]:     <rng supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>random</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egd</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>builtin</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </rng>
Nov 08 21:29:51 user nova-compute[75993]:     <filesystem supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='driverType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>path</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>handle</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtiofs</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </filesystem>
Nov 08 21:29:51 user nova-compute[75993]:     <tpm supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-tis</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-crb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>passthrough</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>emulator</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </tpm>
Nov 08 21:29:51 user nova-compute[75993]:   </devices>
Nov 08 21:29:51 user nova-compute[75993]:   <features>
Nov 08 21:29:51 user nova-compute[75993]:     <gic supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     <vmcoreinfo supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <genid supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backingStoreInput supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backup supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <sev supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:   </features>
Nov 08 21:29:51 user nova-compute[75993]: </domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:  {{(pid=75993) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 08 21:29:51 user nova-compute[75993]: <domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:   <path>/usr/bin/qemu-system-i386</path>
Nov 08 21:29:51 user nova-compute[75993]:   <domain>kvm</domain>
Nov 08 21:29:51 user nova-compute[75993]:   <machine>pc-q35-jammy</machine>
Nov 08 21:29:51 user nova-compute[75993]:   <arch>i686</arch>
Nov 08 21:29:51 user nova-compute[75993]:   <vcpu max='288'/>
Nov 08 21:29:51 user nova-compute[75993]:   <iothreads supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:   <os supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='firmware'/>
Nov 08 21:29:51 user nova-compute[75993]:     <loader supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>rom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pflash</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='readonly'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>yes</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='secure'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </loader>
Nov 08 21:29:51 user nova-compute[75993]:   </os>
Nov 08 21:29:51 user nova-compute[75993]:   <cpu>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-passthrough' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='hostPassthroughMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='maximum' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='maximumMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-model' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <vendor>Intel</vendor>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ss'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='vmx'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pcid'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='hypervisor'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arat'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='umip'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='md-clear'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibpb'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibrs'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='erms'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='lm'/>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='custom' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>qemu64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>qemu32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>phenom</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>n270</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>kvm64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>coreduo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>core2duo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>athlon</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Westmere-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Westmere</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Snowridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Penryn</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G5</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G4</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G1</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Nehalem-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Nehalem</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Rome</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Milan</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Dhyana</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cooperlake</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Conroe</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>486</model>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:   </cpu>
Nov 08 21:29:51 user nova-compute[75993]:   <memoryBacking supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='sourceType'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>file</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>anonymous</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>memfd</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:   </memoryBacking>
Nov 08 21:29:51 user nova-compute[75993]:   <devices>
Nov 08 21:29:51 user nova-compute[75993]:     <disk supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='diskDevice'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>disk</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cdrom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>floppy</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>lun</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='bus'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>fdc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sata</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </disk>
Nov 08 21:29:51 user nova-compute[75993]:     <graphics supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sdl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vnc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>spice</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egl-headless</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </graphics>
Nov 08 21:29:51 user nova-compute[75993]:     <video supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='modelType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cirrus</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vmvga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>qxl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>none</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>bochs</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ramfb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </video>
Nov 08 21:29:51 user nova-compute[75993]:     <hostdev supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='mode'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>subsystem</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='startupPolicy'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>default</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>mandatory</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>requisite</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>optional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='subsysType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pci</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='capsType'/>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='pciBackend'/>
Nov 08 21:29:51 user nova-compute[75993]:     </hostdev>
Nov 08 21:29:51 user nova-compute[75993]:     <rng supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>random</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egd</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>builtin</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </rng>
Nov 08 21:29:51 user nova-compute[75993]:     <filesystem supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='driverType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>path</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>handle</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtiofs</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </filesystem>
Nov 08 21:29:51 user nova-compute[75993]:     <tpm supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-tis</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-crb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>passthrough</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>emulator</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </tpm>
Nov 08 21:29:51 user nova-compute[75993]:   </devices>
Nov 08 21:29:51 user nova-compute[75993]:   <features>
Nov 08 21:29:51 user nova-compute[75993]:     <gic supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     <vmcoreinfo supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <genid supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backingStoreInput supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backup supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <sev supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:   </features>
Nov 08 21:29:51 user nova-compute[75993]: </domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:  {{(pid=75993) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 08 21:29:51 user nova-compute[75993]: <domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 21:29:51 user nova-compute[75993]:   <domain>kvm</domain>
Nov 08 21:29:51 user nova-compute[75993]:   <machine>pc-i440fx-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:   <arch>x86_64</arch>
Nov 08 21:29:51 user nova-compute[75993]:   <vcpu max='255'/>
Nov 08 21:29:51 user nova-compute[75993]:   <iothreads supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:   <os supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='firmware'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>efi</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:     <loader supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>rom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pflash</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='readonly'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>yes</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='secure'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </loader>
Nov 08 21:29:51 user nova-compute[75993]:   </os>
Nov 08 21:29:51 user nova-compute[75993]:   <cpu>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-passthrough' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='hostPassthroughMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='maximum' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='maximumMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-model' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <vendor>Intel</vendor>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ss'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='vmx'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pcid'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='hypervisor'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arat'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='umip'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='md-clear'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='invtsc'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibpb'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibrs'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='rsba'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='erms'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='custom' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>qemu64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>qemu32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>phenom</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>n270</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>coreduo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>core2duo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>athlon</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Westmere</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Snowridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Penryn</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G5</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G4</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Opteron_G1</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Nehalem</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Rome</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Milan</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Dhyana</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cooperlake</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Conroe</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>486</model>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:   </cpu>
Nov 08 21:29:51 user nova-compute[75993]:   <memoryBacking supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='sourceType'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>file</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>anonymous</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>memfd</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:   </memoryBacking>
Nov 08 21:29:51 user nova-compute[75993]:   <devices>
Nov 08 21:29:51 user nova-compute[75993]:     <disk supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='diskDevice'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>disk</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cdrom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>floppy</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>lun</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='bus'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ide</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>fdc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sata</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </disk>
Nov 08 21:29:51 user nova-compute[75993]:     <graphics supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sdl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vnc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>spice</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egl-headless</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </graphics>
Nov 08 21:29:51 user nova-compute[75993]:     <video supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='modelType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cirrus</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vmvga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>qxl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>none</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>bochs</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ramfb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </video>
Nov 08 21:29:51 user nova-compute[75993]:     <hostdev supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='mode'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>subsystem</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='startupPolicy'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>default</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>mandatory</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>requisite</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>optional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='subsysType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pci</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='capsType'/>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='pciBackend'/>
Nov 08 21:29:51 user nova-compute[75993]:     </hostdev>
Nov 08 21:29:51 user nova-compute[75993]:     <rng supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>random</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egd</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>builtin</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </rng>
Nov 08 21:29:51 user nova-compute[75993]:     <filesystem supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='driverType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>path</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>handle</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtiofs</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </filesystem>
Nov 08 21:29:51 user nova-compute[75993]:     <tpm supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-tis</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-crb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>passthrough</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>emulator</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </tpm>
Nov 08 21:29:51 user nova-compute[75993]:   </devices>
Nov 08 21:29:51 user nova-compute[75993]:   <features>
Nov 08 21:29:51 user nova-compute[75993]:     <gic supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     <vmcoreinfo supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <genid supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backingStoreInput supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backup supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <sev supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:   </features>
Nov 08 21:29:51 user nova-compute[75993]: </domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:  {{(pid=75993) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 08 21:29:51 user nova-compute[75993]: <domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 21:29:51 user nova-compute[75993]:   <domain>kvm</domain>
Nov 08 21:29:51 user nova-compute[75993]:   <machine>pc-q35-6.2</machine>
Nov 08 21:29:51 user nova-compute[75993]:   <arch>x86_64</arch>
Nov 08 21:29:51 user nova-compute[75993]:   <vcpu max='288'/>
Nov 08 21:29:51 user nova-compute[75993]:   <iothreads supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:   <os supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='firmware'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>efi</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:     <loader supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>rom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pflash</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='readonly'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>yes</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='secure'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>yes</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </loader>
Nov 08 21:29:51 user nova-compute[75993]:   </os>
Nov 08 21:29:51 user nova-compute[75993]:   <cpu>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-passthrough' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='hostPassthroughMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='maximum' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='maximumMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-model' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <vendor>Intel</vendor>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ss'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='vmx'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pcid'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='hypervisor'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arat'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='umip'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='md-clear'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='invtsc'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibpb'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibrs'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='rsba'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='erms'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='custom' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>qemu64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>qemu32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>phenom</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>n270</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>coreduo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>core2duo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>athlon</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Westmere</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Snowridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Penryn</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G5</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G4</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Opteron_G1</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Nehalem</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Rome</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Milan</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Dhyana</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cooperlake</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Conroe</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>486</model>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:   </cpu>
Nov 08 21:29:51 user nova-compute[75993]:   <memoryBacking supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='sourceType'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>file</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>anonymous</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>memfd</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:   </memoryBacking>
Nov 08 21:29:51 user nova-compute[75993]:   <devices>
Nov 08 21:29:51 user nova-compute[75993]:     <disk supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='diskDevice'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>disk</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cdrom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>floppy</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>lun</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='bus'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>fdc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sata</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </disk>
Nov 08 21:29:51 user nova-compute[75993]:     <graphics supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sdl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vnc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>spice</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egl-headless</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </graphics>
Nov 08 21:29:51 user nova-compute[75993]:     <video supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='modelType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cirrus</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vmvga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>qxl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>none</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>bochs</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ramfb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </video>
Nov 08 21:29:51 user nova-compute[75993]:     <hostdev supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='mode'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>subsystem</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='startupPolicy'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>default</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>mandatory</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>requisite</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>optional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='subsysType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pci</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='capsType'/>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='pciBackend'/>
Nov 08 21:29:51 user nova-compute[75993]:     </hostdev>
Nov 08 21:29:51 user nova-compute[75993]:     <rng supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>random</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egd</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>builtin</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </rng>
Nov 08 21:29:51 user nova-compute[75993]:     <filesystem supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='driverType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>path</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>handle</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtiofs</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </filesystem>
Nov 08 21:29:51 user nova-compute[75993]:     <tpm supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-tis</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-crb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>passthrough</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>emulator</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </tpm>
Nov 08 21:29:51 user nova-compute[75993]:   </devices>
Nov 08 21:29:51 user nova-compute[75993]:   <features>
Nov 08 21:29:51 user nova-compute[75993]:     <gic supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     <vmcoreinfo supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <genid supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backingStoreInput supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backup supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <sev supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:   </features>
Nov 08 21:29:51 user nova-compute[75993]: </domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:  {{(pid=75993) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 08 21:29:51 user nova-compute[75993]: <domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 21:29:51 user nova-compute[75993]:   <domain>kvm</domain>
Nov 08 21:29:51 user nova-compute[75993]:   <machine>pc-i440fx-jammy</machine>
Nov 08 21:29:51 user nova-compute[75993]:   <arch>x86_64</arch>
Nov 08 21:29:51 user nova-compute[75993]:   <vcpu max='255'/>
Nov 08 21:29:51 user nova-compute[75993]:   <iothreads supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:   <os supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='firmware'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>efi</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:     <loader supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>rom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pflash</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='readonly'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>yes</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='secure'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </loader>
Nov 08 21:29:51 user nova-compute[75993]:   </os>
Nov 08 21:29:51 user nova-compute[75993]:   <cpu>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-passthrough' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='hostPassthroughMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='maximum' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='maximumMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-model' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <vendor>Intel</vendor>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ss'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='vmx'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pcid'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='hypervisor'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arat'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='umip'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='md-clear'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='invtsc'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibpb'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibrs'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='rsba'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='erms'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='custom' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>qemu64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>qemu32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>phenom</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>n270</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>coreduo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>core2duo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>athlon</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Westmere</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Snowridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Penryn</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G5</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G4</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Opteron_G1</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Nehalem</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Rome</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Milan</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Dhyana</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cooperlake</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Conroe</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>486</model>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:   </cpu>
Nov 08 21:29:51 user nova-compute[75993]:   <memoryBacking supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='sourceType'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>file</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>anonymous</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>memfd</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:   </memoryBacking>
Nov 08 21:29:51 user nova-compute[75993]:   <devices>
Nov 08 21:29:51 user nova-compute[75993]:     <disk supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='diskDevice'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>disk</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cdrom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>floppy</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>lun</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='bus'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ide</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>fdc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sata</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </disk>
Nov 08 21:29:51 user nova-compute[75993]:     <graphics supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sdl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vnc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>spice</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egl-headless</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </graphics>
Nov 08 21:29:51 user nova-compute[75993]:     <video supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='modelType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cirrus</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vmvga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>qxl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>none</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>bochs</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ramfb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </video>
Nov 08 21:29:51 user nova-compute[75993]:     <hostdev supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='mode'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>subsystem</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='startupPolicy'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>default</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>mandatory</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>requisite</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>optional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='subsysType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pci</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='capsType'/>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='pciBackend'/>
Nov 08 21:29:51 user nova-compute[75993]:     </hostdev>
Nov 08 21:29:51 user nova-compute[75993]:     <rng supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>random</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egd</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>builtin</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </rng>
Nov 08 21:29:51 user nova-compute[75993]:     <filesystem supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='driverType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>path</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>handle</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtiofs</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </filesystem>
Nov 08 21:29:51 user nova-compute[75993]:     <tpm supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-tis</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-crb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>passthrough</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>emulator</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </tpm>
Nov 08 21:29:51 user nova-compute[75993]:   </devices>
Nov 08 21:29:51 user nova-compute[75993]:   <features>
Nov 08 21:29:51 user nova-compute[75993]:     <gic supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     <vmcoreinfo supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <genid supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backingStoreInput supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backup supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <sev supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:   </features>
Nov 08 21:29:51 user nova-compute[75993]: </domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:  {{(pid=75993) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 08 21:29:51 user nova-compute[75993]: <domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 08 21:29:51 user nova-compute[75993]:   <domain>kvm</domain>
Nov 08 21:29:51 user nova-compute[75993]:   <machine>pc-q35-jammy</machine>
Nov 08 21:29:51 user nova-compute[75993]:   <arch>x86_64</arch>
Nov 08 21:29:51 user nova-compute[75993]:   <vcpu max='288'/>
Nov 08 21:29:51 user nova-compute[75993]:   <iothreads supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:   <os supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='firmware'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>efi</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:     <loader supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>rom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pflash</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='readonly'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>yes</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='secure'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>yes</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>no</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </loader>
Nov 08 21:29:51 user nova-compute[75993]:   </os>
Nov 08 21:29:51 user nova-compute[75993]:   <cpu>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-passthrough' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='hostPassthroughMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='maximum' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='maximumMigratable'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>on</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>off</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='host-model' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <vendor>Intel</vendor>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ss'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='vmx'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pcid'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='hypervisor'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arat'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='tsc_adjust'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='umip'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='md-clear'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='arch-capabilities'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='invtsc'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibpb'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='ibrs'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-stibp'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='amd-ssbd'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='rsba'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='require' name='pschange-mc-no'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='erms'/>
Nov 08 21:29:51 user nova-compute[75993]:       <feature policy='disable' name='xsaveopt'/>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:     <mode name='custom' supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>qemu64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>qemu32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>phenom</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>pentium</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>n270</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm64</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>kvm32</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>coreduo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>core2duo</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>athlon</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Westmere-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Westmere</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Snowridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Skylake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>SandyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Penryn</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G5</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G4</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G3</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Opteron_G2</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Opteron_G1</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Nehalem</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>IvyBridge</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Icelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Haswell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Rome</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-Milan</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC-IBPB</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>EPYC</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Dhyana</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cooperlake</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>Conroe</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Cascadelake-Server</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-noTSX</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell-IBRS</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='no'>Broadwell</model>
Nov 08 21:29:51 user nova-compute[75993]:       <model usable='yes'>486</model>
Nov 08 21:29:51 user nova-compute[75993]:     </mode>
Nov 08 21:29:51 user nova-compute[75993]:   </cpu>
Nov 08 21:29:51 user nova-compute[75993]:   <memoryBacking supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:     <enum name='sourceType'>
Nov 08 21:29:51 user nova-compute[75993]:       <value>file</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>anonymous</value>
Nov 08 21:29:51 user nova-compute[75993]:       <value>memfd</value>
Nov 08 21:29:51 user nova-compute[75993]:     </enum>
Nov 08 21:29:51 user nova-compute[75993]:   </memoryBacking>
Nov 08 21:29:51 user nova-compute[75993]:   <devices>
Nov 08 21:29:51 user nova-compute[75993]:     <disk supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='diskDevice'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>disk</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cdrom</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>floppy</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>lun</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='bus'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>fdc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sata</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </disk>
Nov 08 21:29:51 user nova-compute[75993]:     <graphics supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='type'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>sdl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vnc</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>spice</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egl-headless</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </graphics>
Nov 08 21:29:51 user nova-compute[75993]:     <video supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='modelType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>cirrus</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>vmvga</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>qxl</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>none</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>bochs</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>ramfb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </video>
Nov 08 21:29:51 user nova-compute[75993]:     <hostdev supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='mode'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>subsystem</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='startupPolicy'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>default</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>mandatory</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>requisite</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>optional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='subsysType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>usb</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>pci</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>scsi</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='capsType'/>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='pciBackend'/>
Nov 08 21:29:51 user nova-compute[75993]:     </hostdev>
Nov 08 21:29:51 user nova-compute[75993]:     <rng supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtio-non-transitional</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>random</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>egd</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>builtin</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </rng>
Nov 08 21:29:51 user nova-compute[75993]:     <filesystem supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='driverType'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>path</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>handle</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>virtiofs</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </filesystem>
Nov 08 21:29:51 user nova-compute[75993]:     <tpm supported='yes'>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='model'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-tis</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>tpm-crb</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:       <enum name='backendModel'>
Nov 08 21:29:51 user nova-compute[75993]:         <value>passthrough</value>
Nov 08 21:29:51 user nova-compute[75993]:         <value>emulator</value>
Nov 08 21:29:51 user nova-compute[75993]:       </enum>
Nov 08 21:29:51 user nova-compute[75993]:     </tpm>
Nov 08 21:29:51 user nova-compute[75993]:   </devices>
Nov 08 21:29:51 user nova-compute[75993]:   <features>
Nov 08 21:29:51 user nova-compute[75993]:     <gic supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:     <vmcoreinfo supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <genid supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backingStoreInput supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <backup supported='yes'/>
Nov 08 21:29:51 user nova-compute[75993]:     <sev supported='no'/>
Nov 08 21:29:51 user nova-compute[75993]:   </features>
Nov 08 21:29:51 user nova-compute[75993]: </domainCapabilities>
Nov 08 21:29:51 user nova-compute[75993]:  {{(pid=75993) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75993) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75993) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Checking secure boot support for host arch (x86_64) {{(pid=75993) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Checking secure boot support for host arch (x86_64) {{(pid=75993) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Checking secure boot support for host arch (x86_64) {{(pid=75993) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 08 21:29:51 user nova-compute[75993]: INFO nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Secure Boot support detected
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] cpu compare xml: <cpu match="exact">
Nov 08 21:29:51 user nova-compute[75993]:   <model>Nehalem</model>
Nov 08 21:29:51 user nova-compute[75993]: </cpu>
Nov 08 21:29:51 user nova-compute[75993]:  {{(pid=75993) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 08 21:29:51 user nova-compute[75993]: INFO nova.virt.node [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Generated node identity 4677e2dc-e2f1-4c4a-b853-94006ef06d81
Nov 08 21:29:51 user nova-compute[75993]: INFO nova.virt.node [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Wrote node identity 4677e2dc-e2f1-4c4a-b853-94006ef06d81 to /opt/stack/data/nova/compute_id
Nov 08 21:29:51 user nova-compute[75993]: WARNING nova.compute.manager [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Compute nodes ['4677e2dc-e2f1-4c4a-b853-94006ef06d81'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 08 21:29:51 user nova-compute[75993]: INFO nova.compute.manager [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 08 21:29:51 user nova-compute[75993]: WARNING nova.compute.manager [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 08 21:29:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:29:51 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:29:51 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:29:51 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Hypervisor/Node resource view: name=user free_ram=10916MB free_disk=26.121578216552734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:29:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:29:51 user nova-compute[75993]: WARNING nova.compute.resource_tracker [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] No compute node record for user:4677e2dc-e2f1-4c4a-b853-94006ef06d81: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 4677e2dc-e2f1-4c4a-b853-94006ef06d81 could not be found.
Nov 08 21:29:51 user nova-compute[75993]: INFO nova.compute.resource_tracker [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Compute node record created for user:user with uuid: 4677e2dc-e2f1-4c4a-b853-94006ef06d81
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:29:52 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] [req-1813c341-b228-40a6-98a0-f2cb57372449] Created resource provider record via placement API for resource provider with UUID 4677e2dc-e2f1-4c4a-b853-94006ef06d81 and name user.
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75993) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 08 21:29:52 user nova-compute[75993]: INFO nova.virt.libvirt.host [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] kernel doesn't support AMD SEV
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Libvirt baseline CPU <cpu>
Nov 08 21:29:52 user nova-compute[75993]:   <arch>x86_64</arch>
Nov 08 21:29:52 user nova-compute[75993]:   <model>Nehalem</model>
Nov 08 21:29:52 user nova-compute[75993]:   <vendor>Intel</vendor>
Nov 08 21:29:52 user nova-compute[75993]:   <topology sockets="6" cores="1" threads="1"/>
Nov 08 21:29:52 user nova-compute[75993]: </cpu>
Nov 08 21:29:52 user nova-compute[75993]:  {{(pid=75993) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Updated inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Updating resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 generation from 0 to 1 during operation: update_inventory {{(pid=75993) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Updating resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 generation from 1 to 2 during operation: update_traits {{(pid=75993) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.service [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Creating RPC server for service compute {{(pid=75993) start /opt/stack/nova/nova/service.py:182}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.service [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] Join ServiceGroup membership for this service compute {{(pid=75993) start /opt/stack/nova/nova/service.py:199}}
Nov 08 21:29:52 user nova-compute[75993]: DEBUG nova.servicegroup.drivers.db [None req-56215cd1-1817-42ee-87b4-00b7f1466961 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75993) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 08 21:30:36 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:30:36 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:30:43 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:30:43 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:30:43 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=10351MB free_disk=26.025344848632812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:30:43 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:30:44 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:30:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:31:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:31:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:31:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:31:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:31:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:31:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:31:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:31:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 21:31:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 21:31:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:31:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:31:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:31:45 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:31:45 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:31:45 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=10283MB free_disk=26.08942413330078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:31:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:32:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:32:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:32:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:32:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:32:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:32:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 21:32:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 21:32:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:32:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:32:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:32:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:32:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:32:47 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:32:47 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=10297MB free_disk=25.842144012451172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:32:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:33:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:33:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:33:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:33:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:33:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 21:33:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 21:33:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:33:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:33:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:33:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:33:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:33:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:33:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:33:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:33:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:33:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:33:49 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:33:49 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:33:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9590MB free_disk=25.869277954101562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:33:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:33:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:33:49 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:33:50 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:33:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:33:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:33:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "adef30df-4254-4133-9db2-4c7708cd1996" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:33:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:55 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:33:55 user nova-compute[75993]: INFO nova.compute.claims [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Claim successful on node user
Nov 08 21:33:55 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:33:55 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:33:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:33:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:33:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:33:55 user nova-compute[75993]: DEBUG nova.network.neutron [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:33:55 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:33:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:33:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:33:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:33:56 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Creating image(s)
Nov 08 21:33:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "/opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:33:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be.part --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:33:56 user nova-compute[75993]: DEBUG nova.policy [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37e02c3f49f1467498623a47a979a65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b3b0aa87ce49949be27025c497a432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be.part --force-share --output=json" returned: 0 in 0.254s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG nova.virt.images [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] 6094807b-c5f6-4b2a-ac9a-5175832ce24b was qcow2, converting to raw {{(pid=75993) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be.part /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be.converted {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be.part /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be.converted" returned: 0 in 0.311s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be.converted --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.658s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:33:57 user nova-compute[75993]: INFO oslo.privsep.daemon [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpavicjk_z/privsep.sock']
Nov 08 21:33:57 user sudo[85269]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpavicjk_z/privsep.sock
Nov 08 21:33:57 user sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 21:33:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:33:57 user nova-compute[75993]: INFO nova.compute.claims [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Claim successful on node user
Nov 08 21:33:58 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:33:58 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:33:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:33:58 user nova-compute[75993]: INFO nova.compute.claims [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Claim successful on node user
Nov 08 21:33:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:33:58 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Creating image(s)
Nov 08 21:33:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:33:58 user nova-compute[75993]: DEBUG nova.policy [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37e02c3f49f1467498623a47a979a65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b3b0aa87ce49949be27025c497a432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:33:59 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:33:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:33:59 user nova-compute[75993]: INFO oslo.privsep.daemon [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Spawned new privsep daemon via rootwrap
Nov 08 21:33:59 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 21:33:59 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 21:33:59 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 08 21:33:59 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85282
Nov 08 21:33:59 user sudo[85269]: pam_unix(sudo:session): session closed for user root
Nov 08 21:33:59 user nova-compute[75993]: WARNING oslo_privsep.priv_context [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] privsep daemon already running
Nov 08 21:33:59 user nova-compute[75993]: DEBUG nova.network.neutron [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Successfully created port: b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG nova.policy [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a86000c1c779497ea6d1c260a633c4d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1951e152e794a0bb0d79af1c933c4a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:33:59 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Creating image(s)
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "/opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "/opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "/opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.198s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.233s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk 1073741824" returned: 0 in 0.052s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.214s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Checking if we can resize image /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk 1073741824" returned: 0 in 0.055s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.490s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Cannot resize image /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Ensure instance console log exists: /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.228s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.223s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk 1073741824" returned: 0 in 0.052s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Cannot resize image /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Ensure instance console log exists: /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.191s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Cannot resize image /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Ensure instance console log exists: /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Successfully created port: bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:34:02 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Successfully created port: 1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:34:02 user nova-compute[75993]: DEBUG nova.network.neutron [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Successfully updated port: b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:34:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquired lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:02 user nova-compute[75993]: DEBUG nova.network.neutron [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG nova.network.neutron [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG nova.compute.manager [req-d89d248a-0087-4b19-84ac-5cbeba70641f req-03631cf9-b816-492c-8f65-9610e9628161 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-changed-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG nova.compute.manager [req-d89d248a-0087-4b19-84ac-5cbeba70641f req-03631cf9-b816-492c-8f65-9610e9628161 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Refreshing instance network info cache due to event network-changed-b8ee949d-fc2c-4df0-811f-eca62af20a5c. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d89d248a-0087-4b19-84ac-5cbeba70641f req-03631cf9-b816-492c-8f65-9610e9628161 service nova] Acquiring lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG nova.compute.manager [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:34:03 user nova-compute[75993]: INFO nova.compute.claims [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Claim successful on node user
Nov 08 21:34:03 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Successfully updated port: bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquired lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:03 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.network.neutron [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updating instance_info_cache with network_info: [{"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Releasing lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Instance network_info: |[{"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d89d248a-0087-4b19-84ac-5cbeba70641f req-03631cf9-b816-492c-8f65-9610e9628161 service nova] Acquired lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.network.neutron [req-d89d248a-0087-4b19-84ac-5cbeba70641f req-03631cf9-b816-492c-8f65-9610e9628161 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Refreshing network info cache for port b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Start _get_guest_xml network_info=[{"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:34:04 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:04 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-55830472',display_name='tempest-ServerRescueNegativeTestJSON-server-55830472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-55830472',id=1,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-30861mpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:33:56Z,user_data=None,user_id='37e02c3f49f1467498623a47a979a65d',uuid=adef30df-4254-4133-9db2-4c7708cd1996,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:c5:88,bridge_name='br-int',has_traffic_filtering=True,id=b8ee949d-fc2c-4df0-811f-eca62af20a5c,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ee949d-fc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.objects.instance [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'pci_devices' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:34:04 user nova-compute[75993]:   <uuid>adef30df-4254-4133-9db2-4c7708cd1996</uuid>
Nov 08 21:34:04 user nova-compute[75993]:   <name>instance-00000001</name>
Nov 08 21:34:04 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:34:04 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:34:04 user nova-compute[75993]:   <metadata>
Nov 08 21:34:04 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:34:04 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:34:04 user nova-compute[75993]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-55830472</nova:name>
Nov 08 21:34:04 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:34:04</nova:creationTime>
Nov 08 21:34:04 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:34:04 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:34:04 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:34:04 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:34:04 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:34:04 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:34:04 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:34:04 user nova-compute[75993]:       <nova:owner>
Nov 08 21:34:04 user nova-compute[75993]:         <nova:user uuid="37e02c3f49f1467498623a47a979a65d">tempest-ServerRescueNegativeTestJSON-1699992008-project-member</nova:user>
Nov 08 21:34:04 user nova-compute[75993]:         <nova:project uuid="b1b3b0aa87ce49949be27025c497a432">tempest-ServerRescueNegativeTestJSON-1699992008</nova:project>
Nov 08 21:34:04 user nova-compute[75993]:       </nova:owner>
Nov 08 21:34:04 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:34:04 user nova-compute[75993]:       <nova:ports>
Nov 08 21:34:04 user nova-compute[75993]:         <nova:port uuid="b8ee949d-fc2c-4df0-811f-eca62af20a5c">
Nov 08 21:34:04 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 21:34:04 user nova-compute[75993]:         </nova:port>
Nov 08 21:34:04 user nova-compute[75993]:       </nova:ports>
Nov 08 21:34:04 user nova-compute[75993]:     </nova:instance>
Nov 08 21:34:04 user nova-compute[75993]:   </metadata>
Nov 08 21:34:04 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:34:04 user nova-compute[75993]:     <system>
Nov 08 21:34:04 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:34:04 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:34:04 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:34:04 user nova-compute[75993]:       <entry name="serial">adef30df-4254-4133-9db2-4c7708cd1996</entry>
Nov 08 21:34:04 user nova-compute[75993]:       <entry name="uuid">adef30df-4254-4133-9db2-4c7708cd1996</entry>
Nov 08 21:34:04 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:34:04 user nova-compute[75993]:     </system>
Nov 08 21:34:04 user nova-compute[75993]:   </sysinfo>
Nov 08 21:34:04 user nova-compute[75993]:   <os>
Nov 08 21:34:04 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:34:04 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:34:04 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:34:04 user nova-compute[75993]:   </os>
Nov 08 21:34:04 user nova-compute[75993]:   <features>
Nov 08 21:34:04 user nova-compute[75993]:     <acpi/>
Nov 08 21:34:04 user nova-compute[75993]:     <apic/>
Nov 08 21:34:04 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:34:04 user nova-compute[75993]:   </features>
Nov 08 21:34:04 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:34:04 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:34:04 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:34:04 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:34:04 user nova-compute[75993]:   </clock>
Nov 08 21:34:04 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:34:04 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:34:04 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:34:04 user nova-compute[75993]:   </cpu>
Nov 08 21:34:04 user nova-compute[75993]:   <devices>
Nov 08 21:34:04 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:34:04 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:34:04 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk"/>
Nov 08 21:34:04 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:34:04 user nova-compute[75993]:     </disk>
Nov 08 21:34:04 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:34:04 user nova-compute[75993]:       <mac address="fa:16:3e:85:c5:88"/>
Nov 08 21:34:04 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:04 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:34:04 user nova-compute[75993]:       <target dev="tapb8ee949d-fc"/>
Nov 08 21:34:04 user nova-compute[75993]:     </interface>
Nov 08 21:34:04 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:34:04 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/console.log" append="off"/>
Nov 08 21:34:04 user nova-compute[75993]:     </serial>
Nov 08 21:34:04 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:34:04 user nova-compute[75993]:     <video>
Nov 08 21:34:04 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:04 user nova-compute[75993]:     </video>
Nov 08 21:34:04 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:34:04 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:34:04 user nova-compute[75993]:     </rng>
Nov 08 21:34:04 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:34:04 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:34:04 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:34:04 user nova-compute[75993]:     </memballoon>
Nov 08 21:34:04 user nova-compute[75993]:   </devices>
Nov 08 21:34:04 user nova-compute[75993]: </domain>
Nov 08 21:34:04 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-55830472',display_name='tempest-ServerRescueNegativeTestJSON-server-55830472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-55830472',id=1,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-30861mpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:33:56Z,user_data=None,user_id='37e02c3f49f1467498623a47a979a65d',uuid=adef30df-4254-4133-9db2-4c7708cd1996,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:c5:88,bridge_name='br-int',has_traffic_filtering=True,id=b8ee949d-fc2c-4df0-811f-eca62af20a5c,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ee949d-fc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG os_vif [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:c5:88,bridge_name='br-int',has_traffic_filtering=True,id=b8ee949d-fc2c-4df0-811f-eca62af20a5c,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ee949d-fc') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Created schema index Interface.name {{(pid=75993) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Created schema index Port.name {{(pid=75993) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Created schema index Bridge.name {{(pid=75993) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [POLLOUT] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.network.neutron [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd6e30383-0b41-5b9a-a761-eee239bbafc7', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:04 user nova-compute[75993]: INFO oslo.privsep.daemon [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpsna5jd9p/privsep.sock']
Nov 08 21:34:04 user sudo[85344]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpsna5jd9p/privsep.sock
Nov 08 21:34:04 user sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 21:34:04 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:34:04 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Creating image(s)
Nov 08 21:34:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "/opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "/opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "/opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Updating instance_info_cache with network_info: [{"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Releasing lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Instance network_info: |[{"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Start _get_guest_xml network_info=[{"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:34:04 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:04 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1971321515',display_name='tempest-ServerRescueNegativeTestJSON-server-1971321515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1971321515',id=2,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-ir161ktw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:33:59Z,user_data=None,user_id='37e02c3f49f1467498623a47a979a65d',uuid=e7d6503c-765f-4652-8865-e6494e6f58d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:c6,bridge_name='br-int',has_traffic_filtering=True,id=bc9ca8a3-f4c5-4268-b587-dd6e8103ba02,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9ca8a3-f4') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:04 user nova-compute[75993]: DEBUG nova.objects.instance [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'pci_devices' on Instance uuid e7d6503c-765f-4652-8865-e6494e6f58d2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.policy [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9276d87f95734c47897fba9ea4fe2d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00def573657242f289160a6a74dd8ad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Successfully updated port: 1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:34:05 user nova-compute[75993]:   <uuid>e7d6503c-765f-4652-8865-e6494e6f58d2</uuid>
Nov 08 21:34:05 user nova-compute[75993]:   <name>instance-00000002</name>
Nov 08 21:34:05 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:34:05 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:34:05 user nova-compute[75993]:   <metadata>
Nov 08 21:34:05 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:34:05 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:34:05 user nova-compute[75993]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1971321515</nova:name>
Nov 08 21:34:05 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:34:04</nova:creationTime>
Nov 08 21:34:05 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:34:05 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:34:05 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:34:05 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:34:05 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:34:05 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:34:05 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:34:05 user nova-compute[75993]:       <nova:owner>
Nov 08 21:34:05 user nova-compute[75993]:         <nova:user uuid="37e02c3f49f1467498623a47a979a65d">tempest-ServerRescueNegativeTestJSON-1699992008-project-member</nova:user>
Nov 08 21:34:05 user nova-compute[75993]:         <nova:project uuid="b1b3b0aa87ce49949be27025c497a432">tempest-ServerRescueNegativeTestJSON-1699992008</nova:project>
Nov 08 21:34:05 user nova-compute[75993]:       </nova:owner>
Nov 08 21:34:05 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:34:05 user nova-compute[75993]:       <nova:ports>
Nov 08 21:34:05 user nova-compute[75993]:         <nova:port uuid="bc9ca8a3-f4c5-4268-b587-dd6e8103ba02">
Nov 08 21:34:05 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 21:34:05 user nova-compute[75993]:         </nova:port>
Nov 08 21:34:05 user nova-compute[75993]:       </nova:ports>
Nov 08 21:34:05 user nova-compute[75993]:     </nova:instance>
Nov 08 21:34:05 user nova-compute[75993]:   </metadata>
Nov 08 21:34:05 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:34:05 user nova-compute[75993]:     <system>
Nov 08 21:34:05 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:34:05 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:34:05 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:34:05 user nova-compute[75993]:       <entry name="serial">e7d6503c-765f-4652-8865-e6494e6f58d2</entry>
Nov 08 21:34:05 user nova-compute[75993]:       <entry name="uuid">e7d6503c-765f-4652-8865-e6494e6f58d2</entry>
Nov 08 21:34:05 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:34:05 user nova-compute[75993]:     </system>
Nov 08 21:34:05 user nova-compute[75993]:   </sysinfo>
Nov 08 21:34:05 user nova-compute[75993]:   <os>
Nov 08 21:34:05 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:34:05 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:34:05 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:34:05 user nova-compute[75993]:   </os>
Nov 08 21:34:05 user nova-compute[75993]:   <features>
Nov 08 21:34:05 user nova-compute[75993]:     <acpi/>
Nov 08 21:34:05 user nova-compute[75993]:     <apic/>
Nov 08 21:34:05 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:34:05 user nova-compute[75993]:   </features>
Nov 08 21:34:05 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:34:05 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:34:05 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:34:05 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:34:05 user nova-compute[75993]:   </clock>
Nov 08 21:34:05 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:34:05 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:34:05 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:34:05 user nova-compute[75993]:   </cpu>
Nov 08 21:34:05 user nova-compute[75993]:   <devices>
Nov 08 21:34:05 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:34:05 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:34:05 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk"/>
Nov 08 21:34:05 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:34:05 user nova-compute[75993]:     </disk>
Nov 08 21:34:05 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:34:05 user nova-compute[75993]:       <mac address="fa:16:3e:fc:64:c6"/>
Nov 08 21:34:05 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:05 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:34:05 user nova-compute[75993]:       <target dev="tapbc9ca8a3-f4"/>
Nov 08 21:34:05 user nova-compute[75993]:     </interface>
Nov 08 21:34:05 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:34:05 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/console.log" append="off"/>
Nov 08 21:34:05 user nova-compute[75993]:     </serial>
Nov 08 21:34:05 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:34:05 user nova-compute[75993]:     <video>
Nov 08 21:34:05 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:05 user nova-compute[75993]:     </video>
Nov 08 21:34:05 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:34:05 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:34:05 user nova-compute[75993]:     </rng>
Nov 08 21:34:05 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:34:05 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:34:05 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:34:05 user nova-compute[75993]:     </memballoon>
Nov 08 21:34:05 user nova-compute[75993]:   </devices>
Nov 08 21:34:05 user nova-compute[75993]: </domain>
Nov 08 21:34:05 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1971321515',display_name='tempest-ServerRescueNegativeTestJSON-server-1971321515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1971321515',id=2,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-ir161ktw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:33:59Z,user_data=None,user_id='37e02c3f49f1467498623a47a979a65d',uuid=e7d6503c-765f-4652-8865-e6494e6f58d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:c6,bridge_name='br-int',has_traffic_filtering=True,id=bc9ca8a3-f4c5-4268-b587-dd6e8103ba02,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9ca8a3-f4') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG os_vif [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:c6,bridge_name='br-int',has_traffic_filtering=True,id=bc9ca8a3-f4c5-4268-b587-dd6e8103ba02,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9ca8a3-f4') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '754b40bc-d17e-5db0-ab1f-96e363e1da57', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "refresh_cache-a10c0a9d-5398-43db-8589-6e0763d7c5e8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquired lock "refresh_cache-a10c0a9d-5398-43db-8589-6e0763d7c5e8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.159s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk 1073741824" returned: 0 in 0.041s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-7149e491-064f-44b5-ad9b-061d2c7eb1a4 req-aae933a5-2a3e-41f0-8abe-c6b065e076b0 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Received event network-changed-1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-7149e491-064f-44b5-ad9b-061d2c7eb1a4 req-aae933a5-2a3e-41f0-8abe-c6b065e076b0 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Refreshing instance network info cache due to event network-changed-1b82dac2-8540-49cd-88c9-1793a988574d. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7149e491-064f-44b5-ad9b-061d2c7eb1a4 req-aae933a5-2a3e-41f0-8abe-c6b065e076b0 service nova] Acquiring lock "refresh_cache-a10c0a9d-5398-43db-8589-6e0763d7c5e8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-5531a6a8-bcba-455a-acd3-f57dcb3859ff req-32d1be9a-93a0-4e68-a694-e924d053ca7b service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received event network-changed-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-5531a6a8-bcba-455a-acd3-f57dcb3859ff req-32d1be9a-93a0-4e68-a694-e924d053ca7b service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Refreshing instance network info cache due to event network-changed-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5531a6a8-bcba-455a-acd3-f57dcb3859ff req-32d1be9a-93a0-4e68-a694-e924d053ca7b service nova] Acquiring lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5531a6a8-bcba-455a-acd3-f57dcb3859ff req-32d1be9a-93a0-4e68-a694-e924d053ca7b service nova] Acquired lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.network.neutron [req-5531a6a8-bcba-455a-acd3-f57dcb3859ff req-32d1be9a-93a0-4e68-a694-e924d053ca7b service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Refreshing network info cache for port bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Cannot resize image /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Ensure instance console log exists: /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Updating instance_info_cache with network_info: [{"id": "1b82dac2-8540-49cd-88c9-1793a988574d", "address": "fa:16:3e:bb:b4:ce", "network": {"id": "9b94f568-ddd0-4c23-a4d8-eabfca7dab83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1551524033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1951e152e794a0bb0d79af1c933c4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b82dac2-85", "ovs_interfaceid": "1b82dac2-8540-49cd-88c9-1793a988574d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.network.neutron [req-d89d248a-0087-4b19-84ac-5cbeba70641f req-03631cf9-b816-492c-8f65-9610e9628161 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updated VIF entry in instance network info cache for port b8ee949d-fc2c-4df0-811f-eca62af20a5c. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.network.neutron [req-d89d248a-0087-4b19-84ac-5cbeba70641f req-03631cf9-b816-492c-8f65-9610e9628161 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updating instance_info_cache with network_info: [{"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:06 user sudo[85344]: pam_unix(sudo:session): session closed for user root
Nov 08 21:34:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Releasing lock "refresh_cache-a10c0a9d-5398-43db-8589-6e0763d7c5e8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Instance network_info: |[{"id": "1b82dac2-8540-49cd-88c9-1793a988574d", "address": "fa:16:3e:bb:b4:ce", "network": {"id": "9b94f568-ddd0-4c23-a4d8-eabfca7dab83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1551524033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1951e152e794a0bb0d79af1c933c4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b82dac2-85", "ovs_interfaceid": "1b82dac2-8540-49cd-88c9-1793a988574d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7149e491-064f-44b5-ad9b-061d2c7eb1a4 req-aae933a5-2a3e-41f0-8abe-c6b065e076b0 service nova] Acquired lock "refresh_cache-a10c0a9d-5398-43db-8589-6e0763d7c5e8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.network.neutron [req-7149e491-064f-44b5-ad9b-061d2c7eb1a4 req-aae933a5-2a3e-41f0-8abe-c6b065e076b0 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Refreshing network info cache for port 1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Start _get_guest_xml network_info=[{"id": "1b82dac2-8540-49cd-88c9-1793a988574d", "address": "fa:16:3e:bb:b4:ce", "network": {"id": "9b94f568-ddd0-4c23-a4d8-eabfca7dab83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1551524033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1951e152e794a0bb0d79af1c933c4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b82dac2-85", "ovs_interfaceid": "1b82dac2-8540-49cd-88c9-1793a988574d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:34:06 user nova-compute[75993]: INFO oslo.privsep.daemon [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Spawned new privsep daemon via rootwrap
Nov 08 21:34:06 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 21:34:06 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 21:34:06 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 08 21:34:06 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85364
Nov 08 21:34:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d89d248a-0087-4b19-84ac-5cbeba70641f req-03631cf9-b816-492c-8f65-9610e9628161 service nova] Releasing lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:06 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:06 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:33:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1208221641',display_name='tempest-DeleteServersTestJSON-server-1208221641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1208221641',id=3,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1951e152e794a0bb0d79af1c933c4a7',ramdisk_id='',reservation_id='r-e932l8vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1907290067',owner_user_name='tempest-DeleteServersTestJSON-1907290067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:33:59Z,user_data=None,user_id='a86000c1c779497ea6d1c260a633c4d3',uuid=a10c0a9d-5398-43db-8589-6e0763d7c5e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b82dac2-8540-49cd-88c9-1793a988574d", "address": "fa:16:3e:bb:b4:ce", "network": {"id": "9b94f568-ddd0-4c23-a4d8-eabfca7dab83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1551524033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1951e152e794a0bb0d79af1c933c4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b82dac2-85", "ovs_interfaceid": "1b82dac2-8540-49cd-88c9-1793a988574d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Converting VIF {"id": "1b82dac2-8540-49cd-88c9-1793a988574d", "address": "fa:16:3e:bb:b4:ce", "network": {"id": "9b94f568-ddd0-4c23-a4d8-eabfca7dab83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1551524033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1951e152e794a0bb0d79af1c933c4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b82dac2-85", "ovs_interfaceid": "1b82dac2-8540-49cd-88c9-1793a988574d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b4:ce,bridge_name='br-int',has_traffic_filtering=True,id=1b82dac2-8540-49cd-88c9-1793a988574d,network=Network(9b94f568-ddd0-4c23-a4d8-eabfca7dab83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b82dac2-85') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.objects.instance [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lazy-loading 'pci_devices' on Instance uuid a10c0a9d-5398-43db-8589-6e0763d7c5e8 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:34:06 user nova-compute[75993]: WARNING oslo_privsep.priv_context [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] privsep daemon already running
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:34:06 user nova-compute[75993]:   <uuid>a10c0a9d-5398-43db-8589-6e0763d7c5e8</uuid>
Nov 08 21:34:06 user nova-compute[75993]:   <name>instance-00000003</name>
Nov 08 21:34:06 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:34:06 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:34:06 user nova-compute[75993]:   <metadata>
Nov 08 21:34:06 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:34:06 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:34:06 user nova-compute[75993]:       <nova:name>tempest-DeleteServersTestJSON-server-1208221641</nova:name>
Nov 08 21:34:06 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:34:06</nova:creationTime>
Nov 08 21:34:06 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:34:06 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:34:06 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:34:06 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:34:06 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:34:06 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:34:06 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:34:06 user nova-compute[75993]:       <nova:owner>
Nov 08 21:34:06 user nova-compute[75993]:         <nova:user uuid="a86000c1c779497ea6d1c260a633c4d3">tempest-DeleteServersTestJSON-1907290067-project-member</nova:user>
Nov 08 21:34:06 user nova-compute[75993]:         <nova:project uuid="d1951e152e794a0bb0d79af1c933c4a7">tempest-DeleteServersTestJSON-1907290067</nova:project>
Nov 08 21:34:06 user nova-compute[75993]:       </nova:owner>
Nov 08 21:34:06 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:34:06 user nova-compute[75993]:       <nova:ports>
Nov 08 21:34:06 user nova-compute[75993]:         <nova:port uuid="1b82dac2-8540-49cd-88c9-1793a988574d">
Nov 08 21:34:06 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 21:34:06 user nova-compute[75993]:         </nova:port>
Nov 08 21:34:06 user nova-compute[75993]:       </nova:ports>
Nov 08 21:34:06 user nova-compute[75993]:     </nova:instance>
Nov 08 21:34:06 user nova-compute[75993]:   </metadata>
Nov 08 21:34:06 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:34:06 user nova-compute[75993]:     <system>
Nov 08 21:34:06 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:34:06 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:34:06 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:34:06 user nova-compute[75993]:       <entry name="serial">a10c0a9d-5398-43db-8589-6e0763d7c5e8</entry>
Nov 08 21:34:06 user nova-compute[75993]:       <entry name="uuid">a10c0a9d-5398-43db-8589-6e0763d7c5e8</entry>
Nov 08 21:34:06 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:34:06 user nova-compute[75993]:     </system>
Nov 08 21:34:06 user nova-compute[75993]:   </sysinfo>
Nov 08 21:34:06 user nova-compute[75993]:   <os>
Nov 08 21:34:06 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:34:06 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:34:06 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:34:06 user nova-compute[75993]:   </os>
Nov 08 21:34:06 user nova-compute[75993]:   <features>
Nov 08 21:34:06 user nova-compute[75993]:     <acpi/>
Nov 08 21:34:06 user nova-compute[75993]:     <apic/>
Nov 08 21:34:06 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:34:06 user nova-compute[75993]:   </features>
Nov 08 21:34:06 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:34:06 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:34:06 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:34:06 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:34:06 user nova-compute[75993]:   </clock>
Nov 08 21:34:06 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:34:06 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:34:06 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:34:06 user nova-compute[75993]:   </cpu>
Nov 08 21:34:06 user nova-compute[75993]:   <devices>
Nov 08 21:34:06 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:34:06 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:34:06 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk"/>
Nov 08 21:34:06 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:34:06 user nova-compute[75993]:     </disk>
Nov 08 21:34:06 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:34:06 user nova-compute[75993]:       <mac address="fa:16:3e:bb:b4:ce"/>
Nov 08 21:34:06 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:06 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:34:06 user nova-compute[75993]:       <target dev="tap1b82dac2-85"/>
Nov 08 21:34:06 user nova-compute[75993]:     </interface>
Nov 08 21:34:06 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:34:06 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/console.log" append="off"/>
Nov 08 21:34:06 user nova-compute[75993]:     </serial>
Nov 08 21:34:06 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:34:06 user nova-compute[75993]:     <video>
Nov 08 21:34:06 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:06 user nova-compute[75993]:     </video>
Nov 08 21:34:06 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:34:06 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:34:06 user nova-compute[75993]:     </rng>
Nov 08 21:34:06 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:34:06 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:34:06 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:34:06 user nova-compute[75993]:     </memballoon>
Nov 08 21:34:06 user nova-compute[75993]:   </devices>
Nov 08 21:34:06 user nova-compute[75993]: </domain>
Nov 08 21:34:06 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:33:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1208221641',display_name='tempest-DeleteServersTestJSON-server-1208221641',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1208221641',id=3,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1951e152e794a0bb0d79af1c933c4a7',ramdisk_id='',reservation_id='r-e932l8vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1907290067',owner_user_name='tempest-DeleteServersTestJSON-1907290067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:33:59Z,user_data=None,user_id='a86000c1c779497ea6d1c260a633c4d3',uuid=a10c0a9d-5398-43db-8589-6e0763d7c5e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b82dac2-8540-49cd-88c9-1793a988574d", "address": "fa:16:3e:bb:b4:ce", "network": {"id": "9b94f568-ddd0-4c23-a4d8-eabfca7dab83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1551524033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1951e152e794a0bb0d79af1c933c4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b82dac2-85", "ovs_interfaceid": "1b82dac2-8540-49cd-88c9-1793a988574d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Converting VIF {"id": "1b82dac2-8540-49cd-88c9-1793a988574d", "address": "fa:16:3e:bb:b4:ce", "network": {"id": "9b94f568-ddd0-4c23-a4d8-eabfca7dab83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1551524033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1951e152e794a0bb0d79af1c933c4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b82dac2-85", "ovs_interfaceid": "1b82dac2-8540-49cd-88c9-1793a988574d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b4:ce,bridge_name='br-int',has_traffic_filtering=True,id=1b82dac2-8540-49cd-88c9-1793a988574d,network=Network(9b94f568-ddd0-4c23-a4d8-eabfca7dab83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b82dac2-85') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG os_vif [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b4:ce,bridge_name='br-int',has_traffic_filtering=True,id=1b82dac2-8540-49cd-88c9-1793a988574d,network=Network(9b94f568-ddd0-4c23-a4d8-eabfca7dab83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b82dac2-85') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20a44cbc-973f-555d-bf5a-8d5da8e58c51', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8ee949d-fc, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8ee949d-fc, col_values=(('qos', UUID('f91c0e91-bd0c-414d-ad07-cdd2a3b5317a')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8ee949d-fc, col_values=(('external_ids', {'iface-id': 'b8ee949d-fc2c-4df0-811f-eca62af20a5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:c5:88', 'vm-uuid': 'adef30df-4254-4133-9db2-4c7708cd1996'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: INFO os_vif [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:c5:88,bridge_name='br-int',has_traffic_filtering=True,id=b8ee949d-fc2c-4df0-811f-eca62af20a5c,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ee949d-fc')
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc9ca8a3-f4, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc9ca8a3-f4, col_values=(('qos', UUID('7ca5a497-aadc-4674-a549-1fc6c1c40e6d')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc9ca8a3-f4, col_values=(('external_ids', {'iface-id': 'bc9ca8a3-f4c5-4268-b587-dd6e8103ba02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:64:c6', 'vm-uuid': 'e7d6503c-765f-4652-8865-e6494e6f58d2'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: INFO os_vif [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:64:c6,bridge_name='br-int',has_traffic_filtering=True,id=bc9ca8a3-f4c5-4268-b587-dd6e8103ba02,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9ca8a3-f4')
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b82dac2-85, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b82dac2-85, col_values=(('qos', UUID('ac34543b-be3e-4a92-a1ef-ae64063a42b9')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b82dac2-85, col_values=(('external_ids', {'iface-id': '1b82dac2-8540-49cd-88c9-1793a988574d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:b4:ce', 'vm-uuid': 'a10c0a9d-5398-43db-8589-6e0763d7c5e8'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:06 user nova-compute[75993]: INFO os_vif [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b4:ce,bridge_name='br-int',has_traffic_filtering=True,id=1b82dac2-8540-49cd-88c9-1793a988574d,network=Network(9b94f568-ddd0-4c23-a4d8-eabfca7dab83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b82dac2-85')
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No VIF found with MAC fa:16:3e:85:c5:88, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:34:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No VIF found with MAC fa:16:3e:fc:64:c6, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:34:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:34:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] No VIF found with MAC fa:16:3e:bb:b4:ce, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:34:07 user nova-compute[75993]: DEBUG nova.network.neutron [req-5531a6a8-bcba-455a-acd3-f57dcb3859ff req-32d1be9a-93a0-4e68-a694-e924d053ca7b service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Updated VIF entry in instance network info cache for port bc9ca8a3-f4c5-4268-b587-dd6e8103ba02. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:34:07 user nova-compute[75993]: DEBUG nova.network.neutron [req-5531a6a8-bcba-455a-acd3-f57dcb3859ff req-32d1be9a-93a0-4e68-a694-e924d053ca7b service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Updating instance_info_cache with network_info: [{"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5531a6a8-bcba-455a-acd3-f57dcb3859ff req-32d1be9a-93a0-4e68-a694-e924d053ca7b service nova] Releasing lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Successfully created port: 8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:34:08 user nova-compute[75993]: DEBUG nova.network.neutron [req-7149e491-064f-44b5-ad9b-061d2c7eb1a4 req-aae933a5-2a3e-41f0-8abe-c6b065e076b0 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Updated VIF entry in instance network info cache for port 1b82dac2-8540-49cd-88c9-1793a988574d. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:34:08 user nova-compute[75993]: DEBUG nova.network.neutron [req-7149e491-064f-44b5-ad9b-061d2c7eb1a4 req-aae933a5-2a3e-41f0-8abe-c6b065e076b0 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Updating instance_info_cache with network_info: [{"id": "1b82dac2-8540-49cd-88c9-1793a988574d", "address": "fa:16:3e:bb:b4:ce", "network": {"id": "9b94f568-ddd0-4c23-a4d8-eabfca7dab83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1551524033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1951e152e794a0bb0d79af1c933c4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b82dac2-85", "ovs_interfaceid": "1b82dac2-8540-49cd-88c9-1793a988574d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7149e491-064f-44b5-ad9b-061d2c7eb1a4 req-aae933a5-2a3e-41f0-8abe-c6b065e076b0 service nova] Releasing lock "refresh_cache-a10c0a9d-5398-43db-8589-6e0763d7c5e8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Successfully updated port: 8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquired lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-85d80c37-1040-4059-90d0-9e39ed185c33 req-9b6a3e3c-0340-4c12-a952-ad5c625f887c service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-changed-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-85d80c37-1040-4059-90d0-9e39ed185c33 req-9b6a3e3c-0340-4c12-a952-ad5c625f887c service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Refreshing instance network info cache due to event network-changed-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-85d80c37-1040-4059-90d0-9e39ed185c33 req-9b6a3e3c-0340-4c12-a952-ad5c625f887c service nova] Acquiring lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.network.neutron [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updating instance_info_cache with network_info: [{"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Releasing lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.compute.manager [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance network_info: |[{"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-85d80c37-1040-4059-90d0-9e39ed185c33 req-9b6a3e3c-0340-4c12-a952-ad5c625f887c service nova] Acquired lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.network.neutron [req-85d80c37-1040-4059-90d0-9e39ed185c33 req-9b6a3e3c-0340-4c12-a952-ad5c625f887c service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Refreshing network info cache for port 8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Start _get_guest_xml network_info=[{"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:34:12 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:12 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69742388',display_name='tempest-AttachVolumeTestJSON-server-69742388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69742388',id=4,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6oVnaQGjrVAmxsL/HSmftgrrbaB7fw/oPsVgbPjyOcbxzfpKxxWenMze7QWGbAaraNrcOiGtYnTUSvQT2S8k2jlnDmVZFkcsfxNh5h1CEZ87atD5chgSwK78UubB8vnQ==',key_name='tempest-keypair-1705684380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-ufo08u5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=35ca9fea-481a-42ac-8558-c5140e71de59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.objects.instance [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'pci_devices' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:34:12 user nova-compute[75993]:   <uuid>35ca9fea-481a-42ac-8558-c5140e71de59</uuid>
Nov 08 21:34:12 user nova-compute[75993]:   <name>instance-00000004</name>
Nov 08 21:34:12 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:34:12 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:34:12 user nova-compute[75993]:   <metadata>
Nov 08 21:34:12 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:34:12 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:34:12 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeTestJSON-server-69742388</nova:name>
Nov 08 21:34:12 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:34:12</nova:creationTime>
Nov 08 21:34:12 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:34:12 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:34:12 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:34:12 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:34:12 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:34:12 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:34:12 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:34:12 user nova-compute[75993]:       <nova:owner>
Nov 08 21:34:12 user nova-compute[75993]:         <nova:user uuid="9276d87f95734c47897fba9ea4fe2d94">tempest-AttachVolumeTestJSON-1483084463-project-member</nova:user>
Nov 08 21:34:12 user nova-compute[75993]:         <nova:project uuid="00def573657242f289160a6a74dd8ad3">tempest-AttachVolumeTestJSON-1483084463</nova:project>
Nov 08 21:34:12 user nova-compute[75993]:       </nova:owner>
Nov 08 21:34:12 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:34:12 user nova-compute[75993]:       <nova:ports>
Nov 08 21:34:12 user nova-compute[75993]:         <nova:port uuid="8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2">
Nov 08 21:34:12 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 21:34:12 user nova-compute[75993]:         </nova:port>
Nov 08 21:34:12 user nova-compute[75993]:       </nova:ports>
Nov 08 21:34:12 user nova-compute[75993]:     </nova:instance>
Nov 08 21:34:12 user nova-compute[75993]:   </metadata>
Nov 08 21:34:12 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:34:12 user nova-compute[75993]:     <system>
Nov 08 21:34:12 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:34:12 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:34:12 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:34:12 user nova-compute[75993]:       <entry name="serial">35ca9fea-481a-42ac-8558-c5140e71de59</entry>
Nov 08 21:34:12 user nova-compute[75993]:       <entry name="uuid">35ca9fea-481a-42ac-8558-c5140e71de59</entry>
Nov 08 21:34:12 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:34:12 user nova-compute[75993]:     </system>
Nov 08 21:34:12 user nova-compute[75993]:   </sysinfo>
Nov 08 21:34:12 user nova-compute[75993]:   <os>
Nov 08 21:34:12 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:34:12 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:34:12 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:34:12 user nova-compute[75993]:   </os>
Nov 08 21:34:12 user nova-compute[75993]:   <features>
Nov 08 21:34:12 user nova-compute[75993]:     <acpi/>
Nov 08 21:34:12 user nova-compute[75993]:     <apic/>
Nov 08 21:34:12 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:34:12 user nova-compute[75993]:   </features>
Nov 08 21:34:12 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:34:12 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:34:12 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:34:12 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:34:12 user nova-compute[75993]:   </clock>
Nov 08 21:34:12 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:34:12 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:34:12 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:34:12 user nova-compute[75993]:   </cpu>
Nov 08 21:34:12 user nova-compute[75993]:   <devices>
Nov 08 21:34:12 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:34:12 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:34:12 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk"/>
Nov 08 21:34:12 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:34:12 user nova-compute[75993]:     </disk>
Nov 08 21:34:12 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:34:12 user nova-compute[75993]:       <mac address="fa:16:3e:9e:8c:e8"/>
Nov 08 21:34:12 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:12 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:34:12 user nova-compute[75993]:       <target dev="tap8c7b1cf2-c7"/>
Nov 08 21:34:12 user nova-compute[75993]:     </interface>
Nov 08 21:34:12 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:34:12 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/console.log" append="off"/>
Nov 08 21:34:12 user nova-compute[75993]:     </serial>
Nov 08 21:34:12 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:34:12 user nova-compute[75993]:     <video>
Nov 08 21:34:12 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:12 user nova-compute[75993]:     </video>
Nov 08 21:34:12 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:34:12 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:34:12 user nova-compute[75993]:     </rng>
Nov 08 21:34:12 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:34:12 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:34:12 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:34:12 user nova-compute[75993]:     </memballoon>
Nov 08 21:34:12 user nova-compute[75993]:   </devices>
Nov 08 21:34:12 user nova-compute[75993]: </domain>
Nov 08 21:34:12 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69742388',display_name='tempest-AttachVolumeTestJSON-server-69742388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69742388',id=4,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6oVnaQGjrVAmxsL/HSmftgrrbaB7fw/oPsVgbPjyOcbxzfpKxxWenMze7QWGbAaraNrcOiGtYnTUSvQT2S8k2jlnDmVZFkcsfxNh5h1CEZ87atD5chgSwK78UubB8vnQ==',key_name='tempest-keypair-1705684380',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-ufo08u5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=35ca9fea-481a-42ac-8558-c5140e71de59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG os_vif [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95f43a20-3158-5e1a-be00-087d33226317', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c7b1cf2-c7, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c7b1cf2-c7, col_values=(('qos', UUID('db40437e-729d-46f2-9fc5-16625ed62498')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c7b1cf2-c7, col_values=(('external_ids', {'iface-id': '8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:8c:e8', 'vm-uuid': '35ca9fea-481a-42ac-8558-c5140e71de59'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:12 user nova-compute[75993]: INFO os_vif [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7')
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] No VIF found with MAC fa:16:3e:9e:8c:e8, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:34:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:13 user nova-compute[75993]: DEBUG nova.network.neutron [req-85d80c37-1040-4059-90d0-9e39ed185c33 req-9b6a3e3c-0340-4c12-a952-ad5c625f887c service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updated VIF entry in instance network info cache for port 8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:34:13 user nova-compute[75993]: DEBUG nova.network.neutron [req-85d80c37-1040-4059-90d0-9e39ed185c33 req-9b6a3e3c-0340-4c12-a952-ad5c625f887c service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updating instance_info_cache with network_info: [{"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-85d80c37-1040-4059-90d0-9e39ed185c33 req-9b6a3e3c-0340-4c12-a952-ad5c625f887c service nova] Releasing lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:13 user nova-compute[75993]: DEBUG nova.compute.manager [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:34:14 user nova-compute[75993]: INFO nova.compute.claims [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Claim successful on node user
Nov 08 21:34:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.626s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:34:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Instance spawned successfully.
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.network.neutron [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:34:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.policy [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c9d198bd0b540b6839c534f99897aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3754aebc3a46f2988be1bcf1319aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:34:15 user nova-compute[75993]: INFO nova.compute.manager [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Took 19.01 seconds to spawn the instance on the hypervisor.
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:34:15 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Creating image(s)
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "/opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "/opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "/opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:15 user nova-compute[75993]: INFO nova.compute.manager [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Took 20.32 seconds to build instance.
Nov 08 21:34:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-678d94a4-5496-4106-a51d-3d263d6b52e0 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "adef30df-4254-4133-9db2-4c7708cd1996" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.713s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:34:15 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Instance spawned successfully.
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.388s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:15 user nova-compute[75993]: INFO nova.compute.manager [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Took 16.93 seconds to spawn the instance on the hypervisor.
Nov 08 21:34:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.273s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk 1073741824" returned: 0 in 0.061s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:15 user nova-compute[75993]: INFO nova.compute.manager [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Took 18.00 seconds to build instance.
Nov 08 21:34:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7899f8d3-c32f-4a31-aec2-d6677faaaf1b tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.182s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.234s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:34:16 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Instance spawned successfully.
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Cannot resize image /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Ensure instance console log exists: /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:16 user nova-compute[75993]: INFO nova.compute.manager [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Took 16.80 seconds to spawn the instance on the hypervisor.
Nov 08 21:34:16 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:34:16 user nova-compute[75993]: INFO nova.compute.manager [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Took 17.91 seconds to build instance.
Nov 08 21:34:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1f5ceba3-7d60-43df-868d-bc0e154b07c9 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.166s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG nova.compute.manager [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:34:17 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance spawned successfully.
Nov 08 21:34:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:17 user nova-compute[75993]: INFO nova.compute.manager [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Took 12.45 seconds to spawn the instance on the hypervisor.
Nov 08 21:34:17 user nova-compute[75993]: DEBUG nova.compute.manager [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:17 user nova-compute[75993]: INFO nova.compute.manager [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Took 13.76 seconds to build instance.
Nov 08 21:34:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-180cf481-b89b-4e66-93df-e5e88d3c36c7 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.923s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:18 user nova-compute[75993]: DEBUG nova.network.neutron [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Successfully created port: 81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:34:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:21 user nova-compute[75993]: DEBUG nova.network.neutron [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Successfully updated port: 81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:34:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquired lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:21 user nova-compute[75993]: DEBUG nova.network.neutron [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:34:21 user nova-compute[75993]: DEBUG nova.compute.manager [req-8112ed40-8605-408f-bd16-502910a0e7bc req-906ac4cd-cfab-4cee-a5d3-ef190eba37f2 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Received event network-changed-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:21 user nova-compute[75993]: DEBUG nova.compute.manager [req-8112ed40-8605-408f-bd16-502910a0e7bc req-906ac4cd-cfab-4cee-a5d3-ef190eba37f2 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Refreshing instance network info cache due to event network-changed-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:34:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8112ed40-8605-408f-bd16-502910a0e7bc req-906ac4cd-cfab-4cee-a5d3-ef190eba37f2 service nova] Acquiring lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.network.neutron [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.network.neutron [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Updating instance_info_cache with network_info: [{"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Releasing lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.compute.manager [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Instance network_info: |[{"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8112ed40-8605-408f-bd16-502910a0e7bc req-906ac4cd-cfab-4cee-a5d3-ef190eba37f2 service nova] Acquired lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.network.neutron [req-8112ed40-8605-408f-bd16-502910a0e7bc req-906ac4cd-cfab-4cee-a5d3-ef190eba37f2 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Refreshing network info cache for port 81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Start _get_guest_xml network_info=[{"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:34:22 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:22 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-541923797',display_name='tempest-VolumesAdminNegativeTest-server-541923797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-541923797',id=5,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUiWjr4KieaILSNGph5j63JcNFT9vhaGUoB1CySUE0bCdDQ5HIvmE+gxwvtLvNtbAvbHULeUm3W0dSR6Qbjt17Th2rTEkU1KyXxyetG8KiKaQo1oFlDrZlcK6gLXS7Ypw==',key_name='tempest-keypair-1614028420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb3754aebc3a46f2988be1bcf1319aa5',ramdisk_id='',reservation_id='r-za1ab90r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1328949075',owner_user_name='tempest-VolumesAdminNegativeTest-1328949075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9d198bd0b540b6839c534f99897aed',uuid=0965adf7-0f82-4dfa-8d1d-8dafb805a132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converting VIF {"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:30:7b,bridge_name='br-int',has_traffic_filtering=True,id=81a8f9a5-5955-4ba0-89fb-47a5c3328a3b,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a8f9a5-59') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.objects.instance [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lazy-loading 'pci_devices' on Instance uuid 0965adf7-0f82-4dfa-8d1d-8dafb805a132 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:34:22 user nova-compute[75993]:   <uuid>0965adf7-0f82-4dfa-8d1d-8dafb805a132</uuid>
Nov 08 21:34:22 user nova-compute[75993]:   <name>instance-00000005</name>
Nov 08 21:34:22 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:34:22 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:34:22 user nova-compute[75993]:   <metadata>
Nov 08 21:34:22 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:34:22 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:34:22 user nova-compute[75993]:       <nova:name>tempest-VolumesAdminNegativeTest-server-541923797</nova:name>
Nov 08 21:34:22 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:34:22</nova:creationTime>
Nov 08 21:34:22 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:34:22 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:34:22 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:34:22 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:34:22 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:34:22 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:34:22 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:34:22 user nova-compute[75993]:       <nova:owner>
Nov 08 21:34:22 user nova-compute[75993]:         <nova:user uuid="7c9d198bd0b540b6839c534f99897aed">tempest-VolumesAdminNegativeTest-1328949075-project-member</nova:user>
Nov 08 21:34:22 user nova-compute[75993]:         <nova:project uuid="eb3754aebc3a46f2988be1bcf1319aa5">tempest-VolumesAdminNegativeTest-1328949075</nova:project>
Nov 08 21:34:22 user nova-compute[75993]:       </nova:owner>
Nov 08 21:34:22 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:34:22 user nova-compute[75993]:       <nova:ports>
Nov 08 21:34:22 user nova-compute[75993]:         <nova:port uuid="81a8f9a5-5955-4ba0-89fb-47a5c3328a3b">
Nov 08 21:34:22 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 21:34:22 user nova-compute[75993]:         </nova:port>
Nov 08 21:34:22 user nova-compute[75993]:       </nova:ports>
Nov 08 21:34:22 user nova-compute[75993]:     </nova:instance>
Nov 08 21:34:22 user nova-compute[75993]:   </metadata>
Nov 08 21:34:22 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:34:22 user nova-compute[75993]:     <system>
Nov 08 21:34:22 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:34:22 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:34:22 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:34:22 user nova-compute[75993]:       <entry name="serial">0965adf7-0f82-4dfa-8d1d-8dafb805a132</entry>
Nov 08 21:34:22 user nova-compute[75993]:       <entry name="uuid">0965adf7-0f82-4dfa-8d1d-8dafb805a132</entry>
Nov 08 21:34:22 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:34:22 user nova-compute[75993]:     </system>
Nov 08 21:34:22 user nova-compute[75993]:   </sysinfo>
Nov 08 21:34:22 user nova-compute[75993]:   <os>
Nov 08 21:34:22 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:34:22 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:34:22 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:34:22 user nova-compute[75993]:   </os>
Nov 08 21:34:22 user nova-compute[75993]:   <features>
Nov 08 21:34:22 user nova-compute[75993]:     <acpi/>
Nov 08 21:34:22 user nova-compute[75993]:     <apic/>
Nov 08 21:34:22 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:34:22 user nova-compute[75993]:   </features>
Nov 08 21:34:22 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:34:22 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:34:22 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:34:22 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:34:22 user nova-compute[75993]:   </clock>
Nov 08 21:34:22 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:34:22 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:34:22 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:34:22 user nova-compute[75993]:   </cpu>
Nov 08 21:34:22 user nova-compute[75993]:   <devices>
Nov 08 21:34:22 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:34:22 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:34:22 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk"/>
Nov 08 21:34:22 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:34:22 user nova-compute[75993]:     </disk>
Nov 08 21:34:22 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:34:22 user nova-compute[75993]:       <mac address="fa:16:3e:7d:30:7b"/>
Nov 08 21:34:22 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:22 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:34:22 user nova-compute[75993]:       <target dev="tap81a8f9a5-59"/>
Nov 08 21:34:22 user nova-compute[75993]:     </interface>
Nov 08 21:34:22 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:34:22 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/console.log" append="off"/>
Nov 08 21:34:22 user nova-compute[75993]:     </serial>
Nov 08 21:34:22 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:34:22 user nova-compute[75993]:     <video>
Nov 08 21:34:22 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:22 user nova-compute[75993]:     </video>
Nov 08 21:34:22 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:34:22 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:34:22 user nova-compute[75993]:     </rng>
Nov 08 21:34:22 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:34:22 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:34:22 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:34:22 user nova-compute[75993]:     </memballoon>
Nov 08 21:34:22 user nova-compute[75993]:   </devices>
Nov 08 21:34:22 user nova-compute[75993]: </domain>
Nov 08 21:34:22 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-541923797',display_name='tempest-VolumesAdminNegativeTest-server-541923797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-541923797',id=5,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUiWjr4KieaILSNGph5j63JcNFT9vhaGUoB1CySUE0bCdDQ5HIvmE+gxwvtLvNtbAvbHULeUm3W0dSR6Qbjt17Th2rTEkU1KyXxyetG8KiKaQo1oFlDrZlcK6gLXS7Ypw==',key_name='tempest-keypair-1614028420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb3754aebc3a46f2988be1bcf1319aa5',ramdisk_id='',reservation_id='r-za1ab90r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1328949075',owner_user_name='tempest-VolumesAdminNegativeTest-1328949075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9d198bd0b540b6839c534f99897aed',uuid=0965adf7-0f82-4dfa-8d1d-8dafb805a132,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converting VIF {"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:30:7b,bridge_name='br-int',has_traffic_filtering=True,id=81a8f9a5-5955-4ba0-89fb-47a5c3328a3b,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a8f9a5-59') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG os_vif [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:30:7b,bridge_name='br-int',has_traffic_filtering=True,id=81a8f9a5-5955-4ba0-89fb-47a5c3328a3b,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a8f9a5-59') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d11ff1a-354a-52d0-aa08-1668d67e8b15', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81a8f9a5-59, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap81a8f9a5-59, col_values=(('qos', UUID('b24c2077-8789-4d9b-aa8a-21cc346d430d')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap81a8f9a5-59, col_values=(('external_ids', {'iface-id': '81a8f9a5-5955-4ba0-89fb-47a5c3328a3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:30:7b', 'vm-uuid': '0965adf7-0f82-4dfa-8d1d-8dafb805a132'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:22 user nova-compute[75993]: INFO os_vif [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:30:7b,bridge_name='br-int',has_traffic_filtering=True,id=81a8f9a5-5955-4ba0-89fb-47a5c3328a3b,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a8f9a5-59')
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:34:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] No VIF found with MAC fa:16:3e:7d:30:7b, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:34:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-8112ed40-8605-408f-bd16-502910a0e7bc req-906ac4cd-cfab-4cee-a5d3-ef190eba37f2 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Updated VIF entry in instance network info cache for port 81a8f9a5-5955-4ba0-89fb-47a5c3328a3b. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:34:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-8112ed40-8605-408f-bd16-502910a0e7bc req-906ac4cd-cfab-4cee-a5d3-ef190eba37f2 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Updating instance_info_cache with network_info: [{"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8112ed40-8605-408f-bd16-502910a0e7bc req-906ac4cd-cfab-4cee-a5d3-ef190eba37f2 service nova] Releasing lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:34:25 user nova-compute[75993]: INFO nova.compute.claims [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Claim successful on node user
Nov 08 21:34:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:34:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:34:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:34:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Creating image(s)
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "/opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "/opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG nova.policy [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31bd4afb81724ddfbbbe230ebd7614e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b7b429d0edb493589d12273df3e719c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.260s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.241s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk 1073741824" returned: 0 in 0.078s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-377175b0-c16b-4013-bd18-6d6b2ad4fb50 req-13e88eab-ff08-4364-a9de-ccc27575b24c service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-377175b0-c16b-4013-bd18-6d6b2ad4fb50 req-13e88eab-ff08-4364-a9de-ccc27575b24c service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-377175b0-c16b-4013-bd18-6d6b2ad4fb50 req-13e88eab-ff08-4364-a9de-ccc27575b24c service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-377175b0-c16b-4013-bd18-6d6b2ad4fb50 req-13e88eab-ff08-4364-a9de-ccc27575b24c service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-377175b0-c16b-4013-bd18-6d6b2ad4fb50 req-13e88eab-ff08-4364-a9de-ccc27575b24c service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:26 user nova-compute[75993]: WARNING nova.compute.manager [req-377175b0-c16b-4013-bd18-6d6b2ad4fb50 req-13e88eab-ff08-4364-a9de-ccc27575b24c service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state active and task_state None.
Nov 08 21:34:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.253s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Cannot resize image /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Ensure instance console log exists: /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Successfully created port: 77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:34:27 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Instance spawned successfully.
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:27 user nova-compute[75993]: INFO nova.compute.manager [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Took 12.90 seconds to spawn the instance on the hypervisor.
Nov 08 21:34:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:34:28 user nova-compute[75993]: INFO nova.compute.manager [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Took 14.22 seconds to build instance.
Nov 08 21:34:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-685e4db7-497d-4b6e-96e4-371833cd9094 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.417s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:29 user nova-compute[75993]: WARNING nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state active and task_state None.
Nov 08 21:34:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] No waiting events found dispatching network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:29 user nova-compute[75993]: WARNING nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received unexpected event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 for instance with vm_state active and task_state None.
Nov 08 21:34:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] No waiting events found dispatching network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:29 user nova-compute[75993]: WARNING nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received unexpected event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 for instance with vm_state active and task_state None.
Nov 08 21:34:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Received event network-vif-plugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Acquiring lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] No waiting events found dispatching network-vif-plugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:29 user nova-compute[75993]: WARNING nova.compute.manager [req-be08669a-7087-420e-858f-fb01a5bdcfc5 req-aa55d1c0-02a5-4eab-8e21-f56d843e05c7 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Received unexpected event network-vif-plugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b for instance with vm_state active and task_state None.
Nov 08 21:34:29 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Successfully updated port: 77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquired lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:34:29 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Updating instance_info_cache with network_info: [{"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Releasing lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Instance network_info: |[{"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Start _get_guest_xml network_info=[{"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:34:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1322318591',display_name='tempest-TestVolumeSwap-server-1322318591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1322318591',id=6,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA62/w3fHidfeCfzXoIUEExec0aUb25lsXJf1t1kVWE0e+R/ig0XOuLsM49v70Leeze83mDtt2GTlK0xCFeDrulC2shYuJFiz+lZ224goNRPqgrTRz3ED58cdGEKvtfkw==',key_name='tempest-keypair-743530060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b7b429d0edb493589d12273df3e719c',ramdisk_id='',reservation_id='r-873180es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-825570377',owner_user_name='tempest-TestVolumeSwap-825570377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31bd4afb81724ddfbbbe230ebd7614e0',uuid=f0d20870-4544-428f-8963-4e358845514c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Converting VIF {"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:f8:5d,bridge_name='br-int',has_traffic_filtering=True,id=77583e50-3625-4e95-aaa6-b6b9336e3cd0,network=Network(af329001-edb5-4bfc-8135-d6727fa3e5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77583e50-36') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.objects.instance [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lazy-loading 'pci_devices' on Instance uuid f0d20870-4544-428f-8963-4e358845514c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:34:30 user nova-compute[75993]:   <uuid>f0d20870-4544-428f-8963-4e358845514c</uuid>
Nov 08 21:34:30 user nova-compute[75993]:   <name>instance-00000006</name>
Nov 08 21:34:30 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:34:30 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:34:30 user nova-compute[75993]:   <metadata>
Nov 08 21:34:30 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:34:30 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:34:30 user nova-compute[75993]:       <nova:name>tempest-TestVolumeSwap-server-1322318591</nova:name>
Nov 08 21:34:30 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:34:30</nova:creationTime>
Nov 08 21:34:30 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:34:30 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:34:30 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:34:30 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:34:30 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:34:30 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:34:30 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:34:30 user nova-compute[75993]:       <nova:owner>
Nov 08 21:34:30 user nova-compute[75993]:         <nova:user uuid="31bd4afb81724ddfbbbe230ebd7614e0">tempest-TestVolumeSwap-825570377-project-member</nova:user>
Nov 08 21:34:30 user nova-compute[75993]:         <nova:project uuid="2b7b429d0edb493589d12273df3e719c">tempest-TestVolumeSwap-825570377</nova:project>
Nov 08 21:34:30 user nova-compute[75993]:       </nova:owner>
Nov 08 21:34:30 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:34:30 user nova-compute[75993]:       <nova:ports>
Nov 08 21:34:30 user nova-compute[75993]:         <nova:port uuid="77583e50-3625-4e95-aaa6-b6b9336e3cd0">
Nov 08 21:34:30 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 21:34:30 user nova-compute[75993]:         </nova:port>
Nov 08 21:34:30 user nova-compute[75993]:       </nova:ports>
Nov 08 21:34:30 user nova-compute[75993]:     </nova:instance>
Nov 08 21:34:30 user nova-compute[75993]:   </metadata>
Nov 08 21:34:30 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:34:30 user nova-compute[75993]:     <system>
Nov 08 21:34:30 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:34:30 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:34:30 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:34:30 user nova-compute[75993]:       <entry name="serial">f0d20870-4544-428f-8963-4e358845514c</entry>
Nov 08 21:34:30 user nova-compute[75993]:       <entry name="uuid">f0d20870-4544-428f-8963-4e358845514c</entry>
Nov 08 21:34:30 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:34:30 user nova-compute[75993]:     </system>
Nov 08 21:34:30 user nova-compute[75993]:   </sysinfo>
Nov 08 21:34:30 user nova-compute[75993]:   <os>
Nov 08 21:34:30 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:34:30 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:34:30 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:34:30 user nova-compute[75993]:   </os>
Nov 08 21:34:30 user nova-compute[75993]:   <features>
Nov 08 21:34:30 user nova-compute[75993]:     <acpi/>
Nov 08 21:34:30 user nova-compute[75993]:     <apic/>
Nov 08 21:34:30 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:34:30 user nova-compute[75993]:   </features>
Nov 08 21:34:30 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:34:30 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:34:30 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:34:30 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:34:30 user nova-compute[75993]:   </clock>
Nov 08 21:34:30 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:34:30 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:34:30 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:34:30 user nova-compute[75993]:   </cpu>
Nov 08 21:34:30 user nova-compute[75993]:   <devices>
Nov 08 21:34:30 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:34:30 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:34:30 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk"/>
Nov 08 21:34:30 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:34:30 user nova-compute[75993]:     </disk>
Nov 08 21:34:30 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:34:30 user nova-compute[75993]:       <mac address="fa:16:3e:94:f8:5d"/>
Nov 08 21:34:30 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:30 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:34:30 user nova-compute[75993]:       <target dev="tap77583e50-36"/>
Nov 08 21:34:30 user nova-compute[75993]:     </interface>
Nov 08 21:34:30 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:34:30 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/console.log" append="off"/>
Nov 08 21:34:30 user nova-compute[75993]:     </serial>
Nov 08 21:34:30 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:34:30 user nova-compute[75993]:     <video>
Nov 08 21:34:30 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:30 user nova-compute[75993]:     </video>
Nov 08 21:34:30 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:34:30 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:34:30 user nova-compute[75993]:     </rng>
Nov 08 21:34:30 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:34:30 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:34:30 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:34:30 user nova-compute[75993]:     </memballoon>
Nov 08 21:34:30 user nova-compute[75993]:   </devices>
Nov 08 21:34:30 user nova-compute[75993]: </domain>
Nov 08 21:34:30 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1322318591',display_name='tempest-TestVolumeSwap-server-1322318591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1322318591',id=6,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA62/w3fHidfeCfzXoIUEExec0aUb25lsXJf1t1kVWE0e+R/ig0XOuLsM49v70Leeze83mDtt2GTlK0xCFeDrulC2shYuJFiz+lZ224goNRPqgrTRz3ED58cdGEKvtfkw==',key_name='tempest-keypair-743530060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b7b429d0edb493589d12273df3e719c',ramdisk_id='',reservation_id='r-873180es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-825570377',owner_user_name='tempest-TestVolumeSwap-825570377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31bd4afb81724ddfbbbe230ebd7614e0',uuid=f0d20870-4544-428f-8963-4e358845514c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Converting VIF {"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:f8:5d,bridge_name='br-int',has_traffic_filtering=True,id=77583e50-3625-4e95-aaa6-b6b9336e3cd0,network=Network(af329001-edb5-4bfc-8135-d6727fa3e5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77583e50-36') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG os_vif [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:f8:5d,bridge_name='br-int',has_traffic_filtering=True,id=77583e50-3625-4e95-aaa6-b6b9336e3cd0,network=Network(af329001-edb5-4bfc-8135-d6727fa3e5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77583e50-36') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f19b597b-759d-56d2-933e-58523f606f4b', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77583e50-36, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap77583e50-36, col_values=(('qos', UUID('7a0948a5-c3b6-4331-9bbf-697bcaba1155')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap77583e50-36, col_values=(('external_ids', {'iface-id': '77583e50-3625-4e95-aaa6-b6b9336e3cd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:f8:5d', 'vm-uuid': 'f0d20870-4544-428f-8963-4e358845514c'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:30 user nova-compute[75993]: INFO os_vif [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:f8:5d,bridge_name='br-int',has_traffic_filtering=True,id=77583e50-3625-4e95-aaa6-b6b9336e3cd0,network=Network(af329001-edb5-4bfc-8135-d6727fa3e5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77583e50-36')
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:34:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] No VIF found with MAC fa:16:3e:94:f8:5d, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Received event network-vif-plugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] Acquiring lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.007s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] No waiting events found dispatching network-vif-plugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:31 user nova-compute[75993]: WARNING nova.compute.manager [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Received unexpected event network-vif-plugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b for instance with vm_state active and task_state None.
Nov 08 21:34:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Received event network-changed-77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Refreshing instance network info cache due to event network-changed-77583e50-3625-4e95-aaa6-b6b9336e3cd0. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] Acquiring lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] Acquired lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG nova.network.neutron [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Refreshing network info cache for port 77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:34:31 user nova-compute[75993]: INFO nova.compute.claims [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Claim successful on node user
Nov 08 21:34:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG nova.network.neutron [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Updated VIF entry in instance network info cache for port 77583e50-3625-4e95-aaa6-b6b9336e3cd0. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG nova.network.neutron [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Updating instance_info_cache with network_info: [{"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-771c4fbd-054a-4435-8c44-68857be7f77e req-bfe950cf-756f-4a06-a793-17945a117440 service nova] Releasing lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.895s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG nova.network.neutron [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:34:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:34:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:34:32 user nova-compute[75993]: DEBUG nova.policy [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b13e1fc5636403f88aee213e6d70e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3144772c95b74eecbd2a1781114cfb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:34:33 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Creating image(s)
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.005s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.246s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.204s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk 1073741824" returned: 0 in 0.083s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Successfully created port: d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.262s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Cannot resize image /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Ensure instance console log exists: /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-fe2c1aa0-5f4f-41e4-89cd-af39e7dd600a req-8bae413e-bf4b-412a-a164-437992f53c5d service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Received event network-vif-plugged-1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fe2c1aa0-5f4f-41e4-89cd-af39e7dd600a req-8bae413e-bf4b-412a-a164-437992f53c5d service nova] Acquiring lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fe2c1aa0-5f4f-41e4-89cd-af39e7dd600a req-8bae413e-bf4b-412a-a164-437992f53c5d service nova] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fe2c1aa0-5f4f-41e4-89cd-af39e7dd600a req-8bae413e-bf4b-412a-a164-437992f53c5d service nova] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-fe2c1aa0-5f4f-41e4-89cd-af39e7dd600a req-8bae413e-bf4b-412a-a164-437992f53c5d service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] No waiting events found dispatching network-vif-plugged-1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:34 user nova-compute[75993]: WARNING nova.compute.manager [req-fe2c1aa0-5f4f-41e4-89cd-af39e7dd600a req-8bae413e-bf4b-412a-a164-437992f53c5d service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Received unexpected event network-vif-plugged-1b82dac2-8540-49cd-88c9-1793a988574d for instance with vm_state active and task_state None.
Nov 08 21:34:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Successfully updated port: d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquired lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-41f2f88c-59d6-4f4e-80d2-f360530b22cf req-5809f014-6742-455e-87c2-93ca62fbbe4b service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-changed-d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-41f2f88c-59d6-4f4e-80d2-f360530b22cf req-5809f014-6742-455e-87c2-93ca62fbbe4b service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Refreshing instance network info cache due to event network-changed-d05110a2-8c3f-492e-8f02-77d7e07983cb. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-41f2f88c-59d6-4f4e-80d2-f360530b22cf req-5809f014-6742-455e-87c2-93ca62fbbe4b service nova] Acquiring lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:34:35 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f0d20870-4544-428f-8963-4e358845514c] Instance spawned successfully.
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:35 user nova-compute[75993]: INFO nova.compute.manager [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Took 9.21 seconds to spawn the instance on the hypervisor.
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:34:35 user nova-compute[75993]: INFO nova.compute.manager [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Took 10.37 seconds to build instance.
Nov 08 21:34:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5523a968-f79b-4f51-804e-686014e2b5c5 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.567s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updating instance_info_cache with network_info: [{"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Releasing lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Instance network_info: |[{"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-41f2f88c-59d6-4f4e-80d2-f360530b22cf req-5809f014-6742-455e-87c2-93ca62fbbe4b service nova] Acquired lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.network.neutron [req-41f2f88c-59d6-4f4e-80d2-f360530b22cf req-5809f014-6742-455e-87c2-93ca62fbbe4b service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Refreshing network info cache for port d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Start _get_guest_xml network_info=[{"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:34:35 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:35 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686990095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686990095',id=7,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIYNlWsNYNXIPzYxHJHsqWLqulGXulk0Teiy9wHphwJUB1UKtAxuCAT9/nMP58cJKIagHsE3mNVjHBFc2GKI4Bsmrn42N0sgHxg9hFcGJDRyLkXho/6LRS6t4SoMazlhg==',key_name='tempest-keypair-1407039979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3144772c95b74eecbd2a1781114cfb77',ramdisk_id='',reservation_id='r-5deny31q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1487427237',owner_user_name='tempest-TaggedAttachmentsTest-1487427237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b13e1fc5636403f88aee213e6d70e7d',uuid=c68ac7dc-3b4f-4d34-946d-86e8726c38af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converting VIF {"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:e1:be,bridge_name='br-int',has_traffic_filtering=True,id=d05110a2-8c3f-492e-8f02-77d7e07983cb,network=Network(20c8e227-ffd2-41cd-9947-93c3ec9371aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd05110a2-8c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.objects.instance [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lazy-loading 'pci_devices' on Instance uuid c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:34:35 user nova-compute[75993]:   <uuid>c68ac7dc-3b4f-4d34-946d-86e8726c38af</uuid>
Nov 08 21:34:35 user nova-compute[75993]:   <name>instance-00000007</name>
Nov 08 21:34:35 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:34:35 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:34:35 user nova-compute[75993]:   <metadata>
Nov 08 21:34:35 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:34:35 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:34:35 user nova-compute[75993]:       <nova:name>tempest-device-tagging-server-686990095</nova:name>
Nov 08 21:34:35 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:34:35</nova:creationTime>
Nov 08 21:34:35 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:34:35 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:34:35 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:34:35 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:34:35 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:34:35 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:34:35 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:34:35 user nova-compute[75993]:       <nova:owner>
Nov 08 21:34:35 user nova-compute[75993]:         <nova:user uuid="6b13e1fc5636403f88aee213e6d70e7d">tempest-TaggedAttachmentsTest-1487427237-project-member</nova:user>
Nov 08 21:34:35 user nova-compute[75993]:         <nova:project uuid="3144772c95b74eecbd2a1781114cfb77">tempest-TaggedAttachmentsTest-1487427237</nova:project>
Nov 08 21:34:35 user nova-compute[75993]:       </nova:owner>
Nov 08 21:34:35 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:34:35 user nova-compute[75993]:       <nova:ports>
Nov 08 21:34:35 user nova-compute[75993]:         <nova:port uuid="d05110a2-8c3f-492e-8f02-77d7e07983cb">
Nov 08 21:34:35 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 21:34:35 user nova-compute[75993]:         </nova:port>
Nov 08 21:34:35 user nova-compute[75993]:       </nova:ports>
Nov 08 21:34:35 user nova-compute[75993]:     </nova:instance>
Nov 08 21:34:35 user nova-compute[75993]:   </metadata>
Nov 08 21:34:35 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:34:35 user nova-compute[75993]:     <system>
Nov 08 21:34:35 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:34:35 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:34:35 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:34:35 user nova-compute[75993]:       <entry name="serial">c68ac7dc-3b4f-4d34-946d-86e8726c38af</entry>
Nov 08 21:34:35 user nova-compute[75993]:       <entry name="uuid">c68ac7dc-3b4f-4d34-946d-86e8726c38af</entry>
Nov 08 21:34:35 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:34:35 user nova-compute[75993]:     </system>
Nov 08 21:34:35 user nova-compute[75993]:   </sysinfo>
Nov 08 21:34:35 user nova-compute[75993]:   <os>
Nov 08 21:34:35 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:34:35 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:34:35 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:34:35 user nova-compute[75993]:   </os>
Nov 08 21:34:35 user nova-compute[75993]:   <features>
Nov 08 21:34:35 user nova-compute[75993]:     <acpi/>
Nov 08 21:34:35 user nova-compute[75993]:     <apic/>
Nov 08 21:34:35 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:34:35 user nova-compute[75993]:   </features>
Nov 08 21:34:35 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:34:35 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:34:35 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:34:35 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:34:35 user nova-compute[75993]:   </clock>
Nov 08 21:34:35 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:34:35 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:34:35 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:34:35 user nova-compute[75993]:   </cpu>
Nov 08 21:34:35 user nova-compute[75993]:   <devices>
Nov 08 21:34:35 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:34:35 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:34:35 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk"/>
Nov 08 21:34:35 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:34:35 user nova-compute[75993]:     </disk>
Nov 08 21:34:35 user nova-compute[75993]:     <disk type="file" device="cdrom">
Nov 08 21:34:35 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 21:34:35 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk.config"/>
Nov 08 21:34:35 user nova-compute[75993]:       <target dev="hda" bus="ide"/>
Nov 08 21:34:35 user nova-compute[75993]:     </disk>
Nov 08 21:34:35 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:34:35 user nova-compute[75993]:       <mac address="fa:16:3e:61:e1:be"/>
Nov 08 21:34:35 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:35 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:34:35 user nova-compute[75993]:       <target dev="tapd05110a2-8c"/>
Nov 08 21:34:35 user nova-compute[75993]:     </interface>
Nov 08 21:34:35 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:34:35 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/console.log" append="off"/>
Nov 08 21:34:35 user nova-compute[75993]:     </serial>
Nov 08 21:34:35 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:34:35 user nova-compute[75993]:     <video>
Nov 08 21:34:35 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:35 user nova-compute[75993]:     </video>
Nov 08 21:34:35 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:34:35 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:34:35 user nova-compute[75993]:     </rng>
Nov 08 21:34:35 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:34:35 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:34:35 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:34:35 user nova-compute[75993]:     </memballoon>
Nov 08 21:34:35 user nova-compute[75993]:   </devices>
Nov 08 21:34:35 user nova-compute[75993]: </domain>
Nov 08 21:34:35 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686990095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686990095',id=7,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIYNlWsNYNXIPzYxHJHsqWLqulGXulk0Teiy9wHphwJUB1UKtAxuCAT9/nMP58cJKIagHsE3mNVjHBFc2GKI4Bsmrn42N0sgHxg9hFcGJDRyLkXho/6LRS6t4SoMazlhg==',key_name='tempest-keypair-1407039979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3144772c95b74eecbd2a1781114cfb77',ramdisk_id='',reservation_id='r-5deny31q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1487427237',owner_user_name='tempest-TaggedAttachmentsTest-1487427237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b13e1fc5636403f88aee213e6d70e7d',uuid=c68ac7dc-3b4f-4d34-946d-86e8726c38af,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converting VIF {"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:e1:be,bridge_name='br-int',has_traffic_filtering=True,id=d05110a2-8c3f-492e-8f02-77d7e07983cb,network=Network(20c8e227-ffd2-41cd-9947-93c3ec9371aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd05110a2-8c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG os_vif [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:e1:be,bridge_name='br-int',has_traffic_filtering=True,id=d05110a2-8c3f-492e-8f02-77d7e07983cb,network=Network(20c8e227-ffd2-41cd-9947-93c3ec9371aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd05110a2-8c') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e9b132a2-63bc-54eb-baab-a9ac53a91dc7', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd05110a2-8c, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd05110a2-8c, col_values=(('qos', UUID('ac060513-ccf9-464e-9ea0-f9c846360e5f')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd05110a2-8c, col_values=(('external_ids', {'iface-id': 'd05110a2-8c3f-492e-8f02-77d7e07983cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:e1:be', 'vm-uuid': 'c68ac7dc-3b4f-4d34-946d-86e8726c38af'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:35 user nova-compute[75993]: INFO os_vif [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:e1:be,bridge_name='br-int',has_traffic_filtering=True,id=d05110a2-8c3f-492e-8f02-77d7e07983cb,network=Network(20c8e227-ffd2-41cd-9947-93c3ec9371aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd05110a2-8c')
Nov 08 21:34:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:34:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] No BDM found with device name hda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:34:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] No VIF found with MAC fa:16:3e:61:e1:be, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:34:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Using config drive
Nov 08 21:34:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-2b1db4d6-c091-4a47-9784-ca16ed93942f req-96125bed-3966-414e-9c38-4a890eade5cb service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Received event network-vif-plugged-1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2b1db4d6-c091-4a47-9784-ca16ed93942f req-96125bed-3966-414e-9c38-4a890eade5cb service nova] Acquiring lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2b1db4d6-c091-4a47-9784-ca16ed93942f req-96125bed-3966-414e-9c38-4a890eade5cb service nova] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2b1db4d6-c091-4a47-9784-ca16ed93942f req-96125bed-3966-414e-9c38-4a890eade5cb service nova] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-2b1db4d6-c091-4a47-9784-ca16ed93942f req-96125bed-3966-414e-9c38-4a890eade5cb service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] No waiting events found dispatching network-vif-plugged-1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:36 user nova-compute[75993]: WARNING nova.compute.manager [req-2b1db4d6-c091-4a47-9784-ca16ed93942f req-96125bed-3966-414e-9c38-4a890eade5cb service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Received unexpected event network-vif-plugged-1b82dac2-8540-49cd-88c9-1793a988574d for instance with vm_state active and task_state None.
Nov 08 21:34:36 user nova-compute[75993]: DEBUG nova.network.neutron [req-41f2f88c-59d6-4f4e-80d2-f360530b22cf req-5809f014-6742-455e-87c2-93ca62fbbe4b service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updated VIF entry in instance network info cache for port d05110a2-8c3f-492e-8f02-77d7e07983cb. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:34:36 user nova-compute[75993]: DEBUG nova.network.neutron [req-41f2f88c-59d6-4f4e-80d2-f360530b22cf req-5809f014-6742-455e-87c2-93ca62fbbe4b service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updating instance_info_cache with network_info: [{"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-41f2f88c-59d6-4f4e-80d2-f360530b22cf req-5809f014-6742-455e-87c2-93ca62fbbe4b service nova] Releasing lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Creating config drive at /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk.config
Nov 08 21:34:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7l_eua7f {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7l_eua7f" returned: 0 in 0.062s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-f64b78bf-dd5a-4182-87b3-47d92d078a3c req-37c3bf62-ae07-4863-a7db-e05df39fbf52 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f64b78bf-dd5a-4182-87b3-47d92d078a3c req-37c3bf62-ae07-4863-a7db-e05df39fbf52 service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f64b78bf-dd5a-4182-87b3-47d92d078a3c req-37c3bf62-ae07-4863-a7db-e05df39fbf52 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f64b78bf-dd5a-4182-87b3-47d92d078a3c req-37c3bf62-ae07-4863-a7db-e05df39fbf52 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-f64b78bf-dd5a-4182-87b3-47d92d078a3c req-37c3bf62-ae07-4863-a7db-e05df39fbf52 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:37 user nova-compute[75993]: WARNING nova.compute.manager [req-f64b78bf-dd5a-4182-87b3-47d92d078a3c req-37c3bf62-ae07-4863-a7db-e05df39fbf52 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received unexpected event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with vm_state active and task_state None.
Nov 08 21:34:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-43d95578-350d-49c0-8083-17154cdd8b2f req-3989a461-401d-405f-b116-99247547b01e service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-vif-plugged-d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43d95578-350d-49c0-8083-17154cdd8b2f req-3989a461-401d-405f-b116-99247547b01e service nova] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43d95578-350d-49c0-8083-17154cdd8b2f req-3989a461-401d-405f-b116-99247547b01e service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43d95578-350d-49c0-8083-17154cdd8b2f req-3989a461-401d-405f-b116-99247547b01e service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-43d95578-350d-49c0-8083-17154cdd8b2f req-3989a461-401d-405f-b116-99247547b01e service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] No waiting events found dispatching network-vif-plugged-d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:38 user nova-compute[75993]: WARNING nova.compute.manager [req-43d95578-350d-49c0-8083-17154cdd8b2f req-3989a461-401d-405f-b116-99247547b01e service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received unexpected event network-vif-plugged-d05110a2-8c3f-492e-8f02-77d7e07983cb for instance with vm_state building and task_state spawning.
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Acquiring lock "1a014eaf-7813-445b-b783-282ea30f034c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "1a014eaf-7813-445b-b783-282ea30f034c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:34:39 user nova-compute[75993]: INFO nova.compute.claims [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Claim successful on node user
Nov 08 21:34:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:39 user nova-compute[75993]: WARNING nova.compute.manager [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received unexpected event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with vm_state active and task_state None.
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Received event network-vif-plugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] Lock "f0d20870-4544-428f-8963-4e358845514c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] Lock "f0d20870-4544-428f-8963-4e358845514c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] No waiting events found dispatching network-vif-plugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:39 user nova-compute[75993]: WARNING nova.compute.manager [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Received unexpected event network-vif-plugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 for instance with vm_state active and task_state None.
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Received event network-vif-plugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] Lock "f0d20870-4544-428f-8963-4e358845514c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] Lock "f0d20870-4544-428f-8963-4e358845514c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] No waiting events found dispatching network-vif-plugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:39 user nova-compute[75993]: WARNING nova.compute.manager [req-10d0b235-bcb9-4abc-b00a-8f1d2e0c1cb7 req-1f25d922-24d6-4e71-8794-bdd5acea1f6e service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Received unexpected event network-vif-plugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 for instance with vm_state active and task_state None.
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.network.neutron [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:34:39 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:34:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG nova.policy [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c4ed3d04e034433ba25686e19d55541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7a786ab12104e738a7075f06f65b1ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:34:40 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Creating image(s)
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "/opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "/opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.209s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk 1073741824" returned: 0 in 0.060s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG nova.network.neutron [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Successfully created port: cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.248s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-b19b1821-fbf3-42cb-8b18-d84cb2c9524f req-d6c66a70-0b79-455a-b5a5-4673a41e75ee service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-vif-plugged-d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b19b1821-fbf3-42cb-8b18-d84cb2c9524f req-d6c66a70-0b79-455a-b5a5-4673a41e75ee service nova] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b19b1821-fbf3-42cb-8b18-d84cb2c9524f req-d6c66a70-0b79-455a-b5a5-4673a41e75ee service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b19b1821-fbf3-42cb-8b18-d84cb2c9524f req-d6c66a70-0b79-455a-b5a5-4673a41e75ee service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-b19b1821-fbf3-42cb-8b18-d84cb2c9524f req-d6c66a70-0b79-455a-b5a5-4673a41e75ee service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] No waiting events found dispatching network-vif-plugged-d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:41 user nova-compute[75993]: WARNING nova.compute.manager [req-b19b1821-fbf3-42cb-8b18-d84cb2c9524f req-d6c66a70-0b79-455a-b5a5-4673a41e75ee service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received unexpected event network-vif-plugged-d05110a2-8c3f-492e-8f02-77d7e07983cb for instance with vm_state building and task_state spawning.
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:34:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Instance spawned successfully.
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Cannot resize image /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Ensure instance console log exists: /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:41 user nova-compute[75993]: INFO nova.compute.manager [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Took 8.14 seconds to spawn the instance on the hypervisor.
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:34:41 user nova-compute[75993]: INFO nova.compute.manager [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Took 9.76 seconds to build instance.
Nov 08 21:34:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-06763bfa-1bb6-4d0a-a926-6fd34fd1b041 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.963s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Successfully updated port: cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Acquiring lock "refresh_cache-1a014eaf-7813-445b-b783-282ea30f034c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Acquired lock "refresh_cache-1a014eaf-7813-445b-b783-282ea30f034c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.network.neutron [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.network.neutron [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Updating instance_info_cache with network_info: [{"id": "cb94076d-a437-4177-a03e-5464dbf40fd9", "address": "fa:16:3e:3a:56:bd", "network": {"id": "635bf144-0bb5-4dad-9f1d-25aac4b8c0ad", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-506377129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7a786ab12104e738a7075f06f65b1ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb94076d-a4", "ovs_interfaceid": "cb94076d-a437-4177-a03e-5464dbf40fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Releasing lock "refresh_cache-1a014eaf-7813-445b-b783-282ea30f034c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Instance network_info: |[{"id": "cb94076d-a437-4177-a03e-5464dbf40fd9", "address": "fa:16:3e:3a:56:bd", "network": {"id": "635bf144-0bb5-4dad-9f1d-25aac4b8c0ad", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-506377129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7a786ab12104e738a7075f06f65b1ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb94076d-a4", "ovs_interfaceid": "cb94076d-a437-4177-a03e-5464dbf40fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Start _get_guest_xml network_info=[{"id": "cb94076d-a437-4177-a03e-5464dbf40fd9", "address": "fa:16:3e:3a:56:bd", "network": {"id": "635bf144-0bb5-4dad-9f1d-25aac4b8c0ad", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-506377129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7a786ab12104e738a7075f06f65b1ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb94076d-a4", "ovs_interfaceid": "cb94076d-a437-4177-a03e-5464dbf40fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:34:42 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:42 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1016544502',display_name='tempest-VolumesAssistedSnapshotsTest-server-1016544502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1016544502',id=8,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO3H8QsquBqmuvJsLiPW7MWd4mW5PWrjbnHwuK2LHLzFiERKgsyEPiEDVNcHhRK8EncaXqF3LVv67WXXwE4gE2kNe5/vaVrM2pBfpTvrUStS56JNt+FH8WYu2HZXqblJQ==',key_name='tempest-keypair-1544433234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7a786ab12104e738a7075f06f65b1ed',ramdisk_id='',reservation_id='r-jemil0on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1777990699',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1777990699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4ed3d04e034433ba25686e19d55541',uuid=1a014eaf-7813-445b-b783-282ea30f034c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb94076d-a437-4177-a03e-5464dbf40fd9", "address": "fa:16:3e:3a:56:bd", "network": {"id": "635bf144-0bb5-4dad-9f1d-25aac4b8c0ad", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-506377129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7a786ab12104e738a7075f06f65b1ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb94076d-a4", "ovs_interfaceid": "cb94076d-a437-4177-a03e-5464dbf40fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Converting VIF {"id": "cb94076d-a437-4177-a03e-5464dbf40fd9", "address": "fa:16:3e:3a:56:bd", "network": {"id": "635bf144-0bb5-4dad-9f1d-25aac4b8c0ad", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-506377129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7a786ab12104e738a7075f06f65b1ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb94076d-a4", "ovs_interfaceid": "cb94076d-a437-4177-a03e-5464dbf40fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:56:bd,bridge_name='br-int',has_traffic_filtering=True,id=cb94076d-a437-4177-a03e-5464dbf40fd9,network=Network(635bf144-0bb5-4dad-9f1d-25aac4b8c0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb94076d-a4') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.objects.instance [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a014eaf-7813-445b-b783-282ea30f034c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:34:42 user nova-compute[75993]:   <uuid>1a014eaf-7813-445b-b783-282ea30f034c</uuid>
Nov 08 21:34:42 user nova-compute[75993]:   <name>instance-00000008</name>
Nov 08 21:34:42 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:34:42 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:34:42 user nova-compute[75993]:   <metadata>
Nov 08 21:34:42 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:34:42 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:34:42 user nova-compute[75993]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1016544502</nova:name>
Nov 08 21:34:42 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:34:42</nova:creationTime>
Nov 08 21:34:42 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:34:42 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:34:42 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:34:42 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:34:42 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:34:42 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:34:42 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:34:42 user nova-compute[75993]:       <nova:owner>
Nov 08 21:34:42 user nova-compute[75993]:         <nova:user uuid="8c4ed3d04e034433ba25686e19d55541">tempest-VolumesAssistedSnapshotsTest-1777990699-project-member</nova:user>
Nov 08 21:34:42 user nova-compute[75993]:         <nova:project uuid="d7a786ab12104e738a7075f06f65b1ed">tempest-VolumesAssistedSnapshotsTest-1777990699</nova:project>
Nov 08 21:34:42 user nova-compute[75993]:       </nova:owner>
Nov 08 21:34:42 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:34:42 user nova-compute[75993]:       <nova:ports>
Nov 08 21:34:42 user nova-compute[75993]:         <nova:port uuid="cb94076d-a437-4177-a03e-5464dbf40fd9">
Nov 08 21:34:42 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 21:34:42 user nova-compute[75993]:         </nova:port>
Nov 08 21:34:42 user nova-compute[75993]:       </nova:ports>
Nov 08 21:34:42 user nova-compute[75993]:     </nova:instance>
Nov 08 21:34:42 user nova-compute[75993]:   </metadata>
Nov 08 21:34:42 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:34:42 user nova-compute[75993]:     <system>
Nov 08 21:34:42 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:34:42 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:34:42 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:34:42 user nova-compute[75993]:       <entry name="serial">1a014eaf-7813-445b-b783-282ea30f034c</entry>
Nov 08 21:34:42 user nova-compute[75993]:       <entry name="uuid">1a014eaf-7813-445b-b783-282ea30f034c</entry>
Nov 08 21:34:42 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:34:42 user nova-compute[75993]:     </system>
Nov 08 21:34:42 user nova-compute[75993]:   </sysinfo>
Nov 08 21:34:42 user nova-compute[75993]:   <os>
Nov 08 21:34:42 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:34:42 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:34:42 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:34:42 user nova-compute[75993]:   </os>
Nov 08 21:34:42 user nova-compute[75993]:   <features>
Nov 08 21:34:42 user nova-compute[75993]:     <acpi/>
Nov 08 21:34:42 user nova-compute[75993]:     <apic/>
Nov 08 21:34:42 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:34:42 user nova-compute[75993]:   </features>
Nov 08 21:34:42 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:34:42 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:34:42 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:34:42 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:34:42 user nova-compute[75993]:   </clock>
Nov 08 21:34:42 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:34:42 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:34:42 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:34:42 user nova-compute[75993]:   </cpu>
Nov 08 21:34:42 user nova-compute[75993]:   <devices>
Nov 08 21:34:42 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:34:42 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:34:42 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk"/>
Nov 08 21:34:42 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:34:42 user nova-compute[75993]:     </disk>
Nov 08 21:34:42 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:34:42 user nova-compute[75993]:       <mac address="fa:16:3e:3a:56:bd"/>
Nov 08 21:34:42 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:42 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:34:42 user nova-compute[75993]:       <target dev="tapcb94076d-a4"/>
Nov 08 21:34:42 user nova-compute[75993]:     </interface>
Nov 08 21:34:42 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:34:42 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/console.log" append="off"/>
Nov 08 21:34:42 user nova-compute[75993]:     </serial>
Nov 08 21:34:42 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:34:42 user nova-compute[75993]:     <video>
Nov 08 21:34:42 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:34:42 user nova-compute[75993]:     </video>
Nov 08 21:34:42 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:34:42 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:34:42 user nova-compute[75993]:     </rng>
Nov 08 21:34:42 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:34:42 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:34:42 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:34:42 user nova-compute[75993]:     </memballoon>
Nov 08 21:34:42 user nova-compute[75993]:   </devices>
Nov 08 21:34:42 user nova-compute[75993]: </domain>
Nov 08 21:34:42 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1016544502',display_name='tempest-VolumesAssistedSnapshotsTest-server-1016544502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1016544502',id=8,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO3H8QsquBqmuvJsLiPW7MWd4mW5PWrjbnHwuK2LHLzFiERKgsyEPiEDVNcHhRK8EncaXqF3LVv67WXXwE4gE2kNe5/vaVrM2pBfpTvrUStS56JNt+FH8WYu2HZXqblJQ==',key_name='tempest-keypair-1544433234',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7a786ab12104e738a7075f06f65b1ed',ramdisk_id='',reservation_id='r-jemil0on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1777990699',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1777990699-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4ed3d04e034433ba25686e19d55541',uuid=1a014eaf-7813-445b-b783-282ea30f034c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb94076d-a437-4177-a03e-5464dbf40fd9", "address": "fa:16:3e:3a:56:bd", "network": {"id": "635bf144-0bb5-4dad-9f1d-25aac4b8c0ad", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-506377129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7a786ab12104e738a7075f06f65b1ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb94076d-a4", "ovs_interfaceid": "cb94076d-a437-4177-a03e-5464dbf40fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Converting VIF {"id": "cb94076d-a437-4177-a03e-5464dbf40fd9", "address": "fa:16:3e:3a:56:bd", "network": {"id": "635bf144-0bb5-4dad-9f1d-25aac4b8c0ad", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-506377129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7a786ab12104e738a7075f06f65b1ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb94076d-a4", "ovs_interfaceid": "cb94076d-a437-4177-a03e-5464dbf40fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:56:bd,bridge_name='br-int',has_traffic_filtering=True,id=cb94076d-a437-4177-a03e-5464dbf40fd9,network=Network(635bf144-0bb5-4dad-9f1d-25aac4b8c0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb94076d-a4') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG os_vif [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:56:bd,bridge_name='br-int',has_traffic_filtering=True,id=cb94076d-a437-4177-a03e-5464dbf40fd9,network=Network(635bf144-0bb5-4dad-9f1d-25aac4b8c0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb94076d-a4') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3590267d-e6c8-5728-b133-46dcbdc7082e', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb94076d-a4, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb94076d-a4, col_values=(('qos', UUID('b7d4d8a1-cb17-42d6-bfc4-6deee8b66a10')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb94076d-a4, col_values=(('external_ids', {'iface-id': 'cb94076d-a437-4177-a03e-5464dbf40fd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:56:bd', 'vm-uuid': '1a014eaf-7813-445b-b783-282ea30f034c'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:42 user nova-compute[75993]: INFO os_vif [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:56:bd,bridge_name='br-int',has_traffic_filtering=True,id=cb94076d-a437-4177-a03e-5464dbf40fd9,network=Network(635bf144-0bb5-4dad-9f1d-25aac4b8c0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb94076d-a4')
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:34:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] No VIF found with MAC fa:16:3e:3a:56:bd, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-b8bf2d6e-9813-471d-b198-e15fd3a05455 req-9de56125-8466-4db0-ae35-edcecf20d58b service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Received event network-changed-cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-b8bf2d6e-9813-471d-b198-e15fd3a05455 req-9de56125-8466-4db0-ae35-edcecf20d58b service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Refreshing instance network info cache due to event network-changed-cb94076d-a437-4177-a03e-5464dbf40fd9. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b8bf2d6e-9813-471d-b198-e15fd3a05455 req-9de56125-8466-4db0-ae35-edcecf20d58b service nova] Acquiring lock "refresh_cache-1a014eaf-7813-445b-b783-282ea30f034c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b8bf2d6e-9813-471d-b198-e15fd3a05455 req-9de56125-8466-4db0-ae35-edcecf20d58b service nova] Acquired lock "refresh_cache-1a014eaf-7813-445b-b783-282ea30f034c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-b8bf2d6e-9813-471d-b198-e15fd3a05455 req-9de56125-8466-4db0-ae35-edcecf20d58b service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Refreshing network info cache for port cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-b8bf2d6e-9813-471d-b198-e15fd3a05455 req-9de56125-8466-4db0-ae35-edcecf20d58b service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Updated VIF entry in instance network info cache for port cb94076d-a437-4177-a03e-5464dbf40fd9. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-b8bf2d6e-9813-471d-b198-e15fd3a05455 req-9de56125-8466-4db0-ae35-edcecf20d58b service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Updating instance_info_cache with network_info: [{"id": "cb94076d-a437-4177-a03e-5464dbf40fd9", "address": "fa:16:3e:3a:56:bd", "network": {"id": "635bf144-0bb5-4dad-9f1d-25aac4b8c0ad", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-506377129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7a786ab12104e738a7075f06f65b1ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb94076d-a4", "ovs_interfaceid": "cb94076d-a437-4177-a03e-5464dbf40fd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b8bf2d6e-9813-471d-b198-e15fd3a05455 req-9de56125-8466-4db0-ae35-edcecf20d58b service nova] Releasing lock "refresh_cache-1a014eaf-7813-445b-b783-282ea30f034c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Received event network-vif-plugged-cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] Acquiring lock "1a014eaf-7813-445b-b783-282ea30f034c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] Lock "1a014eaf-7813-445b-b783-282ea30f034c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] Lock "1a014eaf-7813-445b-b783-282ea30f034c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] No waiting events found dispatching network-vif-plugged-cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:45 user nova-compute[75993]: WARNING nova.compute.manager [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Received unexpected event network-vif-plugged-cb94076d-a437-4177-a03e-5464dbf40fd9 for instance with vm_state building and task_state spawning.
Nov 08 21:34:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Received event network-vif-plugged-cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] Acquiring lock "1a014eaf-7813-445b-b783-282ea30f034c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] Lock "1a014eaf-7813-445b-b783-282ea30f034c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] Lock "1a014eaf-7813-445b-b783-282ea30f034c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] No waiting events found dispatching network-vif-plugged-cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:34:45 user nova-compute[75993]: WARNING nova.compute.manager [req-34a11cf8-a6c5-46e5-9999-bb172b5c0506 req-b75afedf-fd7b-4581-9fa4-0f7b711df649 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Received unexpected event network-vif-plugged-cb94076d-a437-4177-a03e-5464dbf40fd9 for instance with vm_state building and task_state spawning.
Nov 08 21:34:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Skipping network cache update for instance because it is Building. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:34:45 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:34:46 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updating instance_info_cache with network_info: [{"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:34:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:34:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:34:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:34:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:34:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Instance spawned successfully.
Nov 08 21:34:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:34:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:34:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:47 user nova-compute[75993]: INFO nova.compute.manager [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Took 7.07 seconds to spawn the instance on the hypervisor.
Nov 08 21:34:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:34:47 user nova-compute[75993]: INFO nova.compute.manager [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Took 8.18 seconds to build instance.
Nov 08 21:34:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9df54fbe-0172-4b4f-a5c9-fe84a68ebfc2 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "1a014eaf-7813-445b-b783-282ea30f034c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.329s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:34:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:34:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:34:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:34:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:34:53 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:53 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:34:53 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7610MB free_disk=25.63817596435547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:34:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:34:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance a10c0a9d-5398-43db-8589-6e0763d7c5e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 35ca9fea-481a-42ac-8558-c5140e71de59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f0d20870-4544-428f-8963-4e358845514c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance c68ac7dc-3b4f-4d34-946d-86e8726c38af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1a014eaf-7813-445b-b783-282ea30f034c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:34:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.016s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:34:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:34:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:35:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:18 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:35:18 user nova-compute[75993]: INFO nova.compute.claims [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Claim successful on node user
Nov 08 21:35:18 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:35:18 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:35:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:35:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:35:19 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:35:19 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:35:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:35:19 user nova-compute[75993]: INFO nova.virt.block_device [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Booting with volume d4af4d21-6fd7-4f91-9cf3-d8e66e91403e at /dev/vda
Nov 08 21:35:19 user nova-compute[75993]: DEBUG nova.policy [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c4d6c12e8b64175af3777dbf15ee11e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '586af433a3ee4cc387be213c0d0fca05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:35:19 user nova-compute[75993]: DEBUG os_brick.utils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:35:19 user nova-compute[75993]: INFO oslo.privsep.daemon [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp508ik0a0/privsep.sock']
Nov 08 21:35:19 user sudo[86994]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp508ik0a0/privsep.sock
Nov 08 21:35:19 user sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 08 21:35:19 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Successfully created port: 39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:35:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Successfully updated port: 39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:35:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "refresh_cache-1299c29d-4c41-43c5-ad63-7eae393065d4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:35:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquired lock "refresh_cache-1299c29d-4c41-43c5-ad63-7eae393065d4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:35:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:35:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-e1facabf-5e69-494b-b55d-796d064013fc req-6c2c2e63-d24c-4150-9289-7c9328818e09 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-changed-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-e1facabf-5e69-494b-b55d-796d064013fc req-6c2c2e63-d24c-4150-9289-7c9328818e09 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Refreshing instance network info cache due to event network-changed-39262978-025e-4d08-a52b-4f361719f74a. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:35:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1facabf-5e69-494b-b55d-796d064013fc req-6c2c2e63-d24c-4150-9289-7c9328818e09 service nova] Acquiring lock "refresh_cache-1299c29d-4c41-43c5-ad63-7eae393065d4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:35:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:35:20 user sudo[86994]: pam_unix(sudo:session): session closed for user root
Nov 08 21:35:20 user nova-compute[75993]: INFO oslo.privsep.daemon [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Spawned new privsep daemon via rootwrap
Nov 08 21:35:20 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 08 21:35:20 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 08 21:35:20 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 08 21:35:20 user nova-compute[75993]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86999
Nov 08 21:35:21 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Updating instance_info_cache with network_info: [{"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8b6077-2909-4359-b4c7-3b050ecc6cb6]: (2,) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Releasing lock "refresh_cache-1299c29d-4c41-43c5-ad63-7eae393065d4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Instance network_info: |[{"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1facabf-5e69-494b-b55d-796d064013fc req-6c2c2e63-d24c-4150-9289-7c9328818e09 service nova] Acquired lock "refresh_cache-1299c29d-4c41-43c5-ad63-7eae393065d4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG nova.network.neutron [req-e1facabf-5e69-494b-b55d-796d064013fc req-6c2c2e63-d24c-4150-9289-7c9328818e09 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Refreshing network info cache for port 39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9690880-3a10-47a9-82e5-7b856f19c830]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:21 user nova-compute[75993]: WARNING os_brick.initiator.connectors.nvmeof [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[371dfabb-2ff8-48c6-80da-90eb42a258e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f0b902-e2ab-4a68-bc16-455a26dd3ce5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a64a238-9d61-4209-a770-3ecb46031aea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:35:21 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ea9d6a-f906-491b-8cb8-3fd60d933c04]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG os_brick.utils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] <== get_connector_properties: return (2048ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Updating existing volume attachment record: 5ad1e281-c464-4a9c-8eee-7151b80e1c13 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG nova.network.neutron [req-e1facabf-5e69-494b-b55d-796d064013fc req-6c2c2e63-d24c-4150-9289-7c9328818e09 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Updated VIF entry in instance network info cache for port 39262978-025e-4d08-a52b-4f361719f74a. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG nova.network.neutron [req-e1facabf-5e69-494b-b55d-796d064013fc req-6c2c2e63-d24c-4150-9289-7c9328818e09 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Updating instance_info_cache with network_info: [{"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1facabf-5e69-494b-b55d-796d064013fc req-6c2c2e63-d24c-4150-9289-7c9328818e09 service nova] Releasing lock "refresh_cache-1299c29d-4c41-43c5-ad63-7eae393065d4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:35:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "9bb5a995-4872-4671-91ab-ca0127d65181" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:35:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:35:26 user nova-compute[75993]: INFO nova.compute.claims [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Claim successful on node user
Nov 08 21:35:26 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:35:26 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:35:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:35:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:35:26 user nova-compute[75993]: DEBUG nova.network.neutron [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:35:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:35:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG nova.policy [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ab412f002ec4fe1b978f874d53a2229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872f700d69d8494f9076e7f0d58e14d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:35:27 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Creating image(s)
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "/opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "/opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.188s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk 1073741824" returned: 0 in 0.061s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Cannot resize image /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Ensure instance console log exists: /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:28 user nova-compute[75993]: DEBUG nova.network.neutron [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Successfully created port: 7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:35:29 user nova-compute[75993]: DEBUG nova.network.neutron [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Successfully updated port: 7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:35:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:35:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquired lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:35:29 user nova-compute[75993]: DEBUG nova.network.neutron [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:35:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-86454e6b-5e3e-49ee-8bae-d898962f184c req-0f12d351-2685-4b46-8170-96e5c720f4c9 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received event network-changed-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-86454e6b-5e3e-49ee-8bae-d898962f184c req-0f12d351-2685-4b46-8170-96e5c720f4c9 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Refreshing instance network info cache due to event network-changed-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:35:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-86454e6b-5e3e-49ee-8bae-d898962f184c req-0f12d351-2685-4b46-8170-96e5c720f4c9 service nova] Acquiring lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:35:29 user nova-compute[75993]: DEBUG nova.network.neutron [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.network.neutron [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Updating instance_info_cache with network_info: [{"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Releasing lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.compute.manager [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Instance network_info: |[{"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-86454e6b-5e3e-49ee-8bae-d898962f184c req-0f12d351-2685-4b46-8170-96e5c720f4c9 service nova] Acquired lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.network.neutron [req-86454e6b-5e3e-49ee-8bae-d898962f184c req-0f12d351-2685-4b46-8170-96e5c720f4c9 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Refreshing network info cache for port 7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Start _get_guest_xml network_info=[{"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:35:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:35:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-75408681',display_name='tempest-TestStampPattern-server-75408681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-75408681',id=10,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzi4BBwOWSPcXvNFJcnuunmlc1jVzPYxgIUIXRPn88VowR8XT4JMB17/mhLEw562KI2F8/I3ODTLYr6iRjeOTY7XOCMuEaybFzaDT0RveYsc2TN5uGVN/y+/gl9KBJK0g==',key_name='tempest-TestStampPattern-232827460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='872f700d69d8494f9076e7f0d58e14d3',ramdisk_id='',reservation_id='r-lt22d8wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1350261875',owner_user_name='tempest-TestStampPattern-1350261875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:35:27Z,user_data=None,user_id='0ab412f002ec4fe1b978f874d53a2229',uuid=9bb5a995-4872-4671-91ab-ca0127d65181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converting VIF {"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d3aebee-e3d9-4c37-be5c-0cc382f7ed59,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3aebee-e3') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.objects.instance [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bb5a995-4872-4671-91ab-ca0127d65181 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:35:30 user nova-compute[75993]:   <uuid>9bb5a995-4872-4671-91ab-ca0127d65181</uuid>
Nov 08 21:35:30 user nova-compute[75993]:   <name>instance-0000000a</name>
Nov 08 21:35:30 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:35:30 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:35:30 user nova-compute[75993]:   <metadata>
Nov 08 21:35:30 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:35:30 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:35:30 user nova-compute[75993]:       <nova:name>tempest-TestStampPattern-server-75408681</nova:name>
Nov 08 21:35:30 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:35:30</nova:creationTime>
Nov 08 21:35:30 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:35:30 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:35:30 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:35:30 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:35:30 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:35:30 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:35:30 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:35:30 user nova-compute[75993]:       <nova:owner>
Nov 08 21:35:30 user nova-compute[75993]:         <nova:user uuid="0ab412f002ec4fe1b978f874d53a2229">tempest-TestStampPattern-1350261875-project-member</nova:user>
Nov 08 21:35:30 user nova-compute[75993]:         <nova:project uuid="872f700d69d8494f9076e7f0d58e14d3">tempest-TestStampPattern-1350261875</nova:project>
Nov 08 21:35:30 user nova-compute[75993]:       </nova:owner>
Nov 08 21:35:30 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:35:30 user nova-compute[75993]:       <nova:ports>
Nov 08 21:35:30 user nova-compute[75993]:         <nova:port uuid="7d3aebee-e3d9-4c37-be5c-0cc382f7ed59">
Nov 08 21:35:30 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 21:35:30 user nova-compute[75993]:         </nova:port>
Nov 08 21:35:30 user nova-compute[75993]:       </nova:ports>
Nov 08 21:35:30 user nova-compute[75993]:     </nova:instance>
Nov 08 21:35:30 user nova-compute[75993]:   </metadata>
Nov 08 21:35:30 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:35:30 user nova-compute[75993]:     <system>
Nov 08 21:35:30 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:35:30 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:35:30 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:35:30 user nova-compute[75993]:       <entry name="serial">9bb5a995-4872-4671-91ab-ca0127d65181</entry>
Nov 08 21:35:30 user nova-compute[75993]:       <entry name="uuid">9bb5a995-4872-4671-91ab-ca0127d65181</entry>
Nov 08 21:35:30 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:35:30 user nova-compute[75993]:     </system>
Nov 08 21:35:30 user nova-compute[75993]:   </sysinfo>
Nov 08 21:35:30 user nova-compute[75993]:   <os>
Nov 08 21:35:30 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:35:30 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:35:30 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:35:30 user nova-compute[75993]:   </os>
Nov 08 21:35:30 user nova-compute[75993]:   <features>
Nov 08 21:35:30 user nova-compute[75993]:     <acpi/>
Nov 08 21:35:30 user nova-compute[75993]:     <apic/>
Nov 08 21:35:30 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:35:30 user nova-compute[75993]:   </features>
Nov 08 21:35:30 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:35:30 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:35:30 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:35:30 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:35:30 user nova-compute[75993]:   </clock>
Nov 08 21:35:30 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:35:30 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:35:30 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:35:30 user nova-compute[75993]:   </cpu>
Nov 08 21:35:30 user nova-compute[75993]:   <devices>
Nov 08 21:35:30 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:35:30 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:35:30 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk"/>
Nov 08 21:35:30 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:35:30 user nova-compute[75993]:     </disk>
Nov 08 21:35:30 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:35:30 user nova-compute[75993]:       <mac address="fa:16:3e:f3:07:9b"/>
Nov 08 21:35:30 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:35:30 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:35:30 user nova-compute[75993]:       <target dev="tap7d3aebee-e3"/>
Nov 08 21:35:30 user nova-compute[75993]:     </interface>
Nov 08 21:35:30 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:35:30 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/console.log" append="off"/>
Nov 08 21:35:30 user nova-compute[75993]:     </serial>
Nov 08 21:35:30 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:35:30 user nova-compute[75993]:     <video>
Nov 08 21:35:30 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:35:30 user nova-compute[75993]:     </video>
Nov 08 21:35:30 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:35:30 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:35:30 user nova-compute[75993]:     </rng>
Nov 08 21:35:30 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:35:30 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:35:30 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:35:30 user nova-compute[75993]:     </memballoon>
Nov 08 21:35:30 user nova-compute[75993]:   </devices>
Nov 08 21:35:30 user nova-compute[75993]: </domain>
Nov 08 21:35:30 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-75408681',display_name='tempest-TestStampPattern-server-75408681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-75408681',id=10,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzi4BBwOWSPcXvNFJcnuunmlc1jVzPYxgIUIXRPn88VowR8XT4JMB17/mhLEw562KI2F8/I3ODTLYr6iRjeOTY7XOCMuEaybFzaDT0RveYsc2TN5uGVN/y+/gl9KBJK0g==',key_name='tempest-TestStampPattern-232827460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='872f700d69d8494f9076e7f0d58e14d3',ramdisk_id='',reservation_id='r-lt22d8wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1350261875',owner_user_name='tempest-TestStampPattern-1350261875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:35:27Z,user_data=None,user_id='0ab412f002ec4fe1b978f874d53a2229',uuid=9bb5a995-4872-4671-91ab-ca0127d65181,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converting VIF {"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d3aebee-e3d9-4c37-be5c-0cc382f7ed59,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3aebee-e3') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG os_vif [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d3aebee-e3d9-4c37-be5c-0cc382f7ed59,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3aebee-e3') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '484754b6-36aa-5543-b7c2-ace83299ecd4', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d3aebee-e3, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d3aebee-e3, col_values=(('qos', UUID('32e78d5e-d2e3-4d98-952b-3ad50771e4df')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d3aebee-e3, col_values=(('external_ids', {'iface-id': '7d3aebee-e3d9-4c37-be5c-0cc382f7ed59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:07:9b', 'vm-uuid': '9bb5a995-4872-4671-91ab-ca0127d65181'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:30 user nova-compute[75993]: INFO os_vif [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d3aebee-e3d9-4c37-be5c-0cc382f7ed59,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3aebee-e3')
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] No VIF found with MAC fa:16:3e:f3:07:9b, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.network.neutron [req-86454e6b-5e3e-49ee-8bae-d898962f184c req-0f12d351-2685-4b46-8170-96e5c720f4c9 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Updated VIF entry in instance network info cache for port 7d3aebee-e3d9-4c37-be5c-0cc382f7ed59. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG nova.network.neutron [req-86454e6b-5e3e-49ee-8bae-d898962f184c req-0f12d351-2685-4b46-8170-96e5c720f4c9 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Updating instance_info_cache with network_info: [{"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:35:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-86454e6b-5e3e-49ee-8bae-d898962f184c req-0f12d351-2685-4b46-8170-96e5c720f4c9 service nova] Releasing lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:35:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-8c159f77-d799-449c-9d4e-f0b5dc60ff6b req-e0faa930-8e89-4cf1-a2e8-11454f91ca62 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received event network-vif-plugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8c159f77-d799-449c-9d4e-f0b5dc60ff6b req-e0faa930-8e89-4cf1-a2e8-11454f91ca62 service nova] Acquiring lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8c159f77-d799-449c-9d4e-f0b5dc60ff6b req-e0faa930-8e89-4cf1-a2e8-11454f91ca62 service nova] Lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8c159f77-d799-449c-9d4e-f0b5dc60ff6b req-e0faa930-8e89-4cf1-a2e8-11454f91ca62 service nova] Lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-8c159f77-d799-449c-9d4e-f0b5dc60ff6b req-e0faa930-8e89-4cf1-a2e8-11454f91ca62 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] No waiting events found dispatching network-vif-plugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:35:32 user nova-compute[75993]: WARNING nova.compute.manager [req-8c159f77-d799-449c-9d4e-f0b5dc60ff6b req-e0faa930-8e89-4cf1-a2e8-11454f91ca62 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received unexpected event network-vif-plugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 for instance with vm_state building and task_state spawning.
Nov 08 21:35:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:35:34 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Instance spawned successfully.
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-a36e239a-5e6b-43e8-9b7b-e807375c2b1c req-7e6ba89c-29c1-48f3-a619-b998bd0dd249 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received event network-vif-plugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a36e239a-5e6b-43e8-9b7b-e807375c2b1c req-7e6ba89c-29c1-48f3-a619-b998bd0dd249 service nova] Acquiring lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a36e239a-5e6b-43e8-9b7b-e807375c2b1c req-7e6ba89c-29c1-48f3-a619-b998bd0dd249 service nova] Lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a36e239a-5e6b-43e8-9b7b-e807375c2b1c req-7e6ba89c-29c1-48f3-a619-b998bd0dd249 service nova] Lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-a36e239a-5e6b-43e8-9b7b-e807375c2b1c req-7e6ba89c-29c1-48f3-a619-b998bd0dd249 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] No waiting events found dispatching network-vif-plugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:35:34 user nova-compute[75993]: WARNING nova.compute.manager [req-a36e239a-5e6b-43e8-9b7b-e807375c2b1c req-7e6ba89c-29c1-48f3-a619-b998bd0dd249 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received unexpected event network-vif-plugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 for instance with vm_state building and task_state spawning.
Nov 08 21:35:34 user nova-compute[75993]: INFO nova.compute.manager [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Took 7.29 seconds to spawn the instance on the hypervisor.
Nov 08 21:35:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:35:34 user nova-compute[75993]: INFO nova.compute.manager [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Took 8.21 seconds to build instance.
Nov 08 21:35:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-273f7583-82d8-4ff9-b2be-6999e5b567c1 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.321s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Acquiring lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:35:43 user nova-compute[75993]: INFO nova.compute.claims [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Claim successful on node user
Nov 08 21:35:43 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:35:43 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:35:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG nova.policy [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7ef5882a60864d00a7561128acad8549', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66bdce5d588a45daa65fd80e83425874', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:35:43 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Creating image(s)
Nov 08 21:35:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "/opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "/opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.200s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Successfully created port: 30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk 1073741824" returned: 0 in 0.077s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Cannot resize image /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Ensure instance console log exists: /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Successfully updated port: 30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Acquiring lock "refresh_cache-d5c049a3-6f20-49d4-90df-e0222c2fdc8b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Acquired lock "refresh_cache-d5c049a3-6f20-49d4-90df-e0222c2fdc8b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-14b16833-2efd-4b62-8f7b-a8be5941dbfd req-4712a2a5-5bc0-4fd1-a8ee-a6c66266d8d2 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Received event network-changed-30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-14b16833-2efd-4b62-8f7b-a8be5941dbfd req-4712a2a5-5bc0-4fd1-a8ee-a6c66266d8d2 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Refreshing instance network info cache due to event network-changed-30a8076c-4978-4b97-89ba-9c7ad154caf5. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-14b16833-2efd-4b62-8f7b-a8be5941dbfd req-4712a2a5-5bc0-4fd1-a8ee-a6c66266d8d2 service nova] Acquiring lock "refresh_cache-d5c049a3-6f20-49d4-90df-e0222c2fdc8b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Updating instance_info_cache with network_info: [{"id": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "address": "fa:16:3e:8d:46:9a", "network": {"id": "cb466d33-80cb-4f0b-8d4f-883361f45943", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262491372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bdce5d588a45daa65fd80e83425874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a8076c-49", "ovs_interfaceid": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Releasing lock "refresh_cache-d5c049a3-6f20-49d4-90df-e0222c2fdc8b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Instance network_info: |[{"id": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "address": "fa:16:3e:8d:46:9a", "network": {"id": "cb466d33-80cb-4f0b-8d4f-883361f45943", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262491372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bdce5d588a45daa65fd80e83425874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a8076c-49", "ovs_interfaceid": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-14b16833-2efd-4b62-8f7b-a8be5941dbfd req-4712a2a5-5bc0-4fd1-a8ee-a6c66266d8d2 service nova] Acquired lock "refresh_cache-d5c049a3-6f20-49d4-90df-e0222c2fdc8b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.network.neutron [req-14b16833-2efd-4b62-8f7b-a8be5941dbfd req-4712a2a5-5bc0-4fd1-a8ee-a6c66266d8d2 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Refreshing network info cache for port 30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Start _get_guest_xml network_info=[{"id": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "address": "fa:16:3e:8d:46:9a", "network": {"id": "cb466d33-80cb-4f0b-8d4f-883361f45943", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262491372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bdce5d588a45daa65fd80e83425874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a8076c-49", "ovs_interfaceid": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:35:45 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:35:45 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:35:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-152548353',display_name='tempest-VolumesActionsTest-instance-152548353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-152548353',id=11,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66bdce5d588a45daa65fd80e83425874',ramdisk_id='',reservation_id='r-dz9ej7dk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1860683721',owner_user_name='tempest-VolumesActionsTest-1860683721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:35:44Z,user_data=None,user_id='7ef5882a60864d00a7561128acad8549',uuid=d5c049a3-6f20-49d4-90df-e0222c2fdc8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "address": "fa:16:3e:8d:46:9a", "network": {"id": "cb466d33-80cb-4f0b-8d4f-883361f45943", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262491372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bdce5d588a45daa65fd80e83425874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a8076c-49", "ovs_interfaceid": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Converting VIF {"id": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "address": "fa:16:3e:8d:46:9a", "network": {"id": "cb466d33-80cb-4f0b-8d4f-883361f45943", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262491372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bdce5d588a45daa65fd80e83425874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a8076c-49", "ovs_interfaceid": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:46:9a,bridge_name='br-int',has_traffic_filtering=True,id=30a8076c-4978-4b97-89ba-9c7ad154caf5,network=Network(cb466d33-80cb-4f0b-8d4f-883361f45943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a8076c-49') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lazy-loading 'pci_devices' on Instance uuid d5c049a3-6f20-49d4-90df-e0222c2fdc8b {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:35:46 user nova-compute[75993]:   <uuid>d5c049a3-6f20-49d4-90df-e0222c2fdc8b</uuid>
Nov 08 21:35:46 user nova-compute[75993]:   <name>instance-0000000b</name>
Nov 08 21:35:46 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:35:46 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:35:46 user nova-compute[75993]:   <metadata>
Nov 08 21:35:46 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:35:46 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:35:46 user nova-compute[75993]:       <nova:name>tempest-VolumesActionsTest-instance-152548353</nova:name>
Nov 08 21:35:46 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:35:45</nova:creationTime>
Nov 08 21:35:46 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:35:46 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:35:46 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:35:46 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:35:46 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:35:46 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:35:46 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:35:46 user nova-compute[75993]:       <nova:owner>
Nov 08 21:35:46 user nova-compute[75993]:         <nova:user uuid="7ef5882a60864d00a7561128acad8549">tempest-VolumesActionsTest-1860683721-project-member</nova:user>
Nov 08 21:35:46 user nova-compute[75993]:         <nova:project uuid="66bdce5d588a45daa65fd80e83425874">tempest-VolumesActionsTest-1860683721</nova:project>
Nov 08 21:35:46 user nova-compute[75993]:       </nova:owner>
Nov 08 21:35:46 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:35:46 user nova-compute[75993]:       <nova:ports>
Nov 08 21:35:46 user nova-compute[75993]:         <nova:port uuid="30a8076c-4978-4b97-89ba-9c7ad154caf5">
Nov 08 21:35:46 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 21:35:46 user nova-compute[75993]:         </nova:port>
Nov 08 21:35:46 user nova-compute[75993]:       </nova:ports>
Nov 08 21:35:46 user nova-compute[75993]:     </nova:instance>
Nov 08 21:35:46 user nova-compute[75993]:   </metadata>
Nov 08 21:35:46 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:35:46 user nova-compute[75993]:     <system>
Nov 08 21:35:46 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:35:46 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:35:46 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:35:46 user nova-compute[75993]:       <entry name="serial">d5c049a3-6f20-49d4-90df-e0222c2fdc8b</entry>
Nov 08 21:35:46 user nova-compute[75993]:       <entry name="uuid">d5c049a3-6f20-49d4-90df-e0222c2fdc8b</entry>
Nov 08 21:35:46 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:35:46 user nova-compute[75993]:     </system>
Nov 08 21:35:46 user nova-compute[75993]:   </sysinfo>
Nov 08 21:35:46 user nova-compute[75993]:   <os>
Nov 08 21:35:46 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:35:46 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:35:46 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:35:46 user nova-compute[75993]:   </os>
Nov 08 21:35:46 user nova-compute[75993]:   <features>
Nov 08 21:35:46 user nova-compute[75993]:     <acpi/>
Nov 08 21:35:46 user nova-compute[75993]:     <apic/>
Nov 08 21:35:46 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:35:46 user nova-compute[75993]:   </features>
Nov 08 21:35:46 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:35:46 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:35:46 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:35:46 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:35:46 user nova-compute[75993]:   </clock>
Nov 08 21:35:46 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:35:46 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:35:46 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:35:46 user nova-compute[75993]:   </cpu>
Nov 08 21:35:46 user nova-compute[75993]:   <devices>
Nov 08 21:35:46 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:35:46 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:35:46 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk"/>
Nov 08 21:35:46 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:35:46 user nova-compute[75993]:     </disk>
Nov 08 21:35:46 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:35:46 user nova-compute[75993]:       <mac address="fa:16:3e:8d:46:9a"/>
Nov 08 21:35:46 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:35:46 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:35:46 user nova-compute[75993]:       <target dev="tap30a8076c-49"/>
Nov 08 21:35:46 user nova-compute[75993]:     </interface>
Nov 08 21:35:46 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:35:46 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/console.log" append="off"/>
Nov 08 21:35:46 user nova-compute[75993]:     </serial>
Nov 08 21:35:46 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:35:46 user nova-compute[75993]:     <video>
Nov 08 21:35:46 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:35:46 user nova-compute[75993]:     </video>
Nov 08 21:35:46 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:35:46 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:35:46 user nova-compute[75993]:     </rng>
Nov 08 21:35:46 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:35:46 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:35:46 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:35:46 user nova-compute[75993]:     </memballoon>
Nov 08 21:35:46 user nova-compute[75993]:   </devices>
Nov 08 21:35:46 user nova-compute[75993]: </domain>
Nov 08 21:35:46 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-152548353',display_name='tempest-VolumesActionsTest-instance-152548353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-152548353',id=11,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66bdce5d588a45daa65fd80e83425874',ramdisk_id='',reservation_id='r-dz9ej7dk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1860683721',owner_user_name='tempest-VolumesActionsTest-1860683721-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:35:44Z,user_data=None,user_id='7ef5882a60864d00a7561128acad8549',uuid=d5c049a3-6f20-49d4-90df-e0222c2fdc8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "address": "fa:16:3e:8d:46:9a", "network": {"id": "cb466d33-80cb-4f0b-8d4f-883361f45943", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262491372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bdce5d588a45daa65fd80e83425874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a8076c-49", "ovs_interfaceid": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Converting VIF {"id": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "address": "fa:16:3e:8d:46:9a", "network": {"id": "cb466d33-80cb-4f0b-8d4f-883361f45943", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262491372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bdce5d588a45daa65fd80e83425874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a8076c-49", "ovs_interfaceid": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:46:9a,bridge_name='br-int',has_traffic_filtering=True,id=30a8076c-4978-4b97-89ba-9c7ad154caf5,network=Network(cb466d33-80cb-4f0b-8d4f-883361f45943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a8076c-49') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_vif [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:46:9a,bridge_name='br-int',has_traffic_filtering=True,id=30a8076c-4978-4b97-89ba-9c7ad154caf5,network=Network(cb466d33-80cb-4f0b-8d4f-883361f45943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a8076c-49') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8da32f29-d470-54a5-9449-56b427d4cdee', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30a8076c-49, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30a8076c-49, col_values=(('qos', UUID('dc687543-6346-48a0-ab09-396b016b0aef')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30a8076c-49, col_values=(('external_ids', {'iface-id': '30a8076c-4978-4b97-89ba-9c7ad154caf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:46:9a', 'vm-uuid': 'd5c049a3-6f20-49d4-90df-e0222c2fdc8b'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:46 user nova-compute[75993]: INFO os_vif [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:46:9a,bridge_name='br-int',has_traffic_filtering=True,id=30a8076c-4978-4b97-89ba-9c7ad154caf5,network=Network(cb466d33-80cb-4f0b-8d4f-883361f45943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a8076c-49')
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] No VIF found with MAC fa:16:3e:8d:46:9a, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.network.neutron [req-14b16833-2efd-4b62-8f7b-a8be5941dbfd req-4712a2a5-5bc0-4fd1-a8ee-a6c66266d8d2 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Updated VIF entry in instance network info cache for port 30a8076c-4978-4b97-89ba-9c7ad154caf5. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.network.neutron [req-14b16833-2efd-4b62-8f7b-a8be5941dbfd req-4712a2a5-5bc0-4fd1-a8ee-a6c66266d8d2 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Updating instance_info_cache with network_info: [{"id": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "address": "fa:16:3e:8d:46:9a", "network": {"id": "cb466d33-80cb-4f0b-8d4f-883361f45943", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262491372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bdce5d588a45daa65fd80e83425874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a8076c-49", "ovs_interfaceid": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-14b16833-2efd-4b62-8f7b-a8be5941dbfd req-4712a2a5-5bc0-4fd1-a8ee-a6c66266d8d2 service nova] Releasing lock "refresh_cache-d5c049a3-6f20-49d4-90df-e0222c2fdc8b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:35:46 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Creating image(s)
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Ensure instance console log exists: /opt/stack/data/nova/instances/1299c29d-4c41-43c5-ad63-7eae393065d4/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Start _get_guest_xml network_info=[{"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '5ad1e281-c464-4a9c-8eee-7151b80e1c13', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQxklKTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1299c29d-4c41-43c5-ad63-7eae393065d4', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 'serial': 'd4af4d21-6fd7-4f91-9cf3-d8e66e91403e'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:35:46 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:35:46 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connector [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Factory for ISCSI on None {{(pid=75993) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQxklKTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:35:46 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:35:46 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:35:46 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae2dc9b-4939-4e9f-b21e-47942e9900e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:35:46 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1872292-d11a-404b-9c3b-72c0c6b1fe15]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e] added
Nov 08 21:35:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cba2a3-7656-47c9-a205-d87662c58394]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[860ad7c0-72cc-4d10-aa2b-2e4aec69fe7c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQxklKTD {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQxklKTD" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afc467c-0c25-44c6-b2bf-075963131b51]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nQxklKTD'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c98eaa2-d18d-4592-a3a0-b3698f7e8a7a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cc5336-0772-433f-a857-e3a58132ec17]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 21:35:46 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 21:35:46 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:35:46 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 21:35:46 user nova-compute[75993]: 
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e8e527-b95b-4911-9167-163a63d22ad3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260]
Nov 08 21:35:46 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260] successful.
Nov 08 21:35:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e6fd3c-700c-43f1-b7b1-adf68a5f3ca3]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4601639-1fd0-4477-9f10-d0f76a002f9d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:35:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:35:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3581dd-4637-45af-aec7-6ec23e7515d0]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQxklKTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-04751f7e-7f4f-487e-905c-cc4890c423cb req-88f778fb-20b1-4e5c-90a0-f97eb60711ff service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Received event network-vif-plugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-04751f7e-7f4f-487e-905c-cc4890c423cb req-88f778fb-20b1-4e5c-90a0-f97eb60711ff service nova] Acquiring lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-04751f7e-7f4f-487e-905c-cc4890c423cb req-88f778fb-20b1-4e5c-90a0-f97eb60711ff service nova] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-04751f7e-7f4f-487e-905c-cc4890c423cb req-88f778fb-20b1-4e5c-90a0-f97eb60711ff service nova] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-04751f7e-7f4f-487e-905c-cc4890c423cb req-88f778fb-20b1-4e5c-90a0-f97eb60711ff service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] No waiting events found dispatching network-vif-plugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:35:47 user nova-compute[75993]: WARNING nova.compute.manager [req-04751f7e-7f4f-487e-905c-cc4890c423cb req-88f778fb-20b1-4e5c-90a0-f97eb60711ff service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Received unexpected event network-vif-plugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 for instance with vm_state building and task_state spawning.
Nov 08 21:35:47 user nova-compute[75993]: INFO nova.compute.manager [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Rescuing
Nov 08 21:35:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquired lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:35:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23236346230653931', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236346230653931', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1121926887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1121926887',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtrasof5VVa4N8t9Ec62wXGBSSsbRBbjGULzKVdN0bVvyZ8swMlrLds8d3lYzELTg6JrOJuucCuAAXEYpOoJNoBGe6KIU1HN5gatSV5zcSocuW2xYg9jQETQ50lGSxPmQ==',key_name='tempest-keypair-601691060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586af433a3ee4cc387be213c0d0fca05',ramdisk_id='',reservation_id='r-sk248x4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-553177767',owner_user_name='tempest-ServerActionsV293TestJSON-553177767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c4d6c12e8b64175af3777dbf15ee11e',uuid=1299c29d-4c41-43c5-ad63-7eae393065d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converting VIF {"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lazy-loading 'pci_devices' on Instance uuid 1299c29d-4c41-43c5-ad63-7eae393065d4 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:35:48 user nova-compute[75993]:   <uuid>1299c29d-4c41-43c5-ad63-7eae393065d4</uuid>
Nov 08 21:35:48 user nova-compute[75993]:   <name>instance-00000009</name>
Nov 08 21:35:48 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:35:48 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:35:48 user nova-compute[75993]:   <metadata>
Nov 08 21:35:48 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:35:48 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:35:48 user nova-compute[75993]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1121926887</nova:name>
Nov 08 21:35:48 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:35:46</nova:creationTime>
Nov 08 21:35:48 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:35:48 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:35:48 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:35:48 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:35:48 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:35:48 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:35:48 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:35:48 user nova-compute[75993]:       <nova:owner>
Nov 08 21:35:48 user nova-compute[75993]:         <nova:user uuid="0c4d6c12e8b64175af3777dbf15ee11e">tempest-ServerActionsV293TestJSON-553177767-project-member</nova:user>
Nov 08 21:35:48 user nova-compute[75993]:         <nova:project uuid="586af433a3ee4cc387be213c0d0fca05">tempest-ServerActionsV293TestJSON-553177767</nova:project>
Nov 08 21:35:48 user nova-compute[75993]:       </nova:owner>
Nov 08 21:35:48 user nova-compute[75993]:       <nova:ports>
Nov 08 21:35:48 user nova-compute[75993]:         <nova:port uuid="39262978-025e-4d08-a52b-4f361719f74a">
Nov 08 21:35:48 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 21:35:48 user nova-compute[75993]:         </nova:port>
Nov 08 21:35:48 user nova-compute[75993]:       </nova:ports>
Nov 08 21:35:48 user nova-compute[75993]:     </nova:instance>
Nov 08 21:35:48 user nova-compute[75993]:   </metadata>
Nov 08 21:35:48 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:35:48 user nova-compute[75993]:     <system>
Nov 08 21:35:48 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:35:48 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:35:48 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:35:48 user nova-compute[75993]:       <entry name="serial">1299c29d-4c41-43c5-ad63-7eae393065d4</entry>
Nov 08 21:35:48 user nova-compute[75993]:       <entry name="uuid">1299c29d-4c41-43c5-ad63-7eae393065d4</entry>
Nov 08 21:35:48 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:35:48 user nova-compute[75993]:     </system>
Nov 08 21:35:48 user nova-compute[75993]:   </sysinfo>
Nov 08 21:35:48 user nova-compute[75993]:   <os>
Nov 08 21:35:48 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:35:48 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:35:48 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:35:48 user nova-compute[75993]:   </os>
Nov 08 21:35:48 user nova-compute[75993]:   <features>
Nov 08 21:35:48 user nova-compute[75993]:     <acpi/>
Nov 08 21:35:48 user nova-compute[75993]:     <apic/>
Nov 08 21:35:48 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:35:48 user nova-compute[75993]:   </features>
Nov 08 21:35:48 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:35:48 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:35:48 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:35:48 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:35:48 user nova-compute[75993]:   </clock>
Nov 08 21:35:48 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:35:48 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:35:48 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:35:48 user nova-compute[75993]:   </cpu>
Nov 08 21:35:48 user nova-compute[75993]:   <devices>
Nov 08 21:35:48 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:35:48 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:35:48 user nova-compute[75993]:       <source dev="/dev/sdb"/>
Nov 08 21:35:48 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:35:48 user nova-compute[75993]:       <serial>d4af4d21-6fd7-4f91-9cf3-d8e66e91403e</serial>
Nov 08 21:35:48 user nova-compute[75993]:     </disk>
Nov 08 21:35:48 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:35:48 user nova-compute[75993]:       <mac address="fa:16:3e:c1:3f:07"/>
Nov 08 21:35:48 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:35:48 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:35:48 user nova-compute[75993]:       <target dev="tap39262978-02"/>
Nov 08 21:35:48 user nova-compute[75993]:     </interface>
Nov 08 21:35:48 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:35:48 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/1299c29d-4c41-43c5-ad63-7eae393065d4/console.log" append="off"/>
Nov 08 21:35:48 user nova-compute[75993]:     </serial>
Nov 08 21:35:48 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:35:48 user nova-compute[75993]:     <video>
Nov 08 21:35:48 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:35:48 user nova-compute[75993]:     </video>
Nov 08 21:35:48 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:35:48 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:35:48 user nova-compute[75993]:     </rng>
Nov 08 21:35:48 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:35:48 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:35:48 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:35:48 user nova-compute[75993]:     </memballoon>
Nov 08 21:35:48 user nova-compute[75993]:   </devices>
Nov 08 21:35:48 user nova-compute[75993]: </domain>
Nov 08 21:35:48 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1121926887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1121926887',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtrasof5VVa4N8t9Ec62wXGBSSsbRBbjGULzKVdN0bVvyZ8swMlrLds8d3lYzELTg6JrOJuucCuAAXEYpOoJNoBGe6KIU1HN5gatSV5zcSocuW2xYg9jQETQ50lGSxPmQ==',key_name='tempest-keypair-601691060',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='586af433a3ee4cc387be213c0d0fca05',ramdisk_id='',reservation_id='r-sk248x4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-553177767',owner_user_name='tempest-ServerActionsV293TestJSON-553177767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:35:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c4d6c12e8b64175af3777dbf15ee11e',uuid=1299c29d-4c41-43c5-ad63-7eae393065d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converting VIF {"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG os_vif [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '237f453f-01ee-51bd-909b-cb3701e1f188', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39262978-02, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39262978-02, col_values=(('qos', UUID('834fc261-fad1-4c8e-9c7f-c0424fc72111')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39262978-02, col_values=(('external_ids', {'iface-id': '39262978-025e-4d08-a52b-4f361719f74a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:3f:07', 'vm-uuid': '1299c29d-4c41-43c5-ad63-7eae393065d4'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:48 user nova-compute[75993]: INFO os_vif [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02')
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] No VIF found with MAC fa:16:3e:c1:3f:07, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Updating instance_info_cache with network_info: [{"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:35:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Releasing lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-21f4710a-3526-4d53-81eb-ddd8c74a33fb req-7016c7cb-8765-45a6-84cf-e93bd170c2c3 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received event network-vif-unplugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-21f4710a-3526-4d53-81eb-ddd8c74a33fb req-7016c7cb-8765-45a6-84cf-e93bd170c2c3 service nova] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-21f4710a-3526-4d53-81eb-ddd8c74a33fb req-7016c7cb-8765-45a6-84cf-e93bd170c2c3 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-21f4710a-3526-4d53-81eb-ddd8c74a33fb req-7016c7cb-8765-45a6-84cf-e93bd170c2c3 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-21f4710a-3526-4d53-81eb-ddd8c74a33fb req-7016c7cb-8765-45a6-84cf-e93bd170c2c3 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] No waiting events found dispatching network-vif-unplugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:35:49 user nova-compute[75993]: WARNING nova.compute.manager [req-21f4710a-3526-4d53-81eb-ddd8c74a33fb req-7016c7cb-8765-45a6-84cf-e93bd170c2c3 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received unexpected event network-vif-unplugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 for instance with vm_state active and task_state rescuing.
Nov 08 21:35:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-423be419-f6a4-4813-9489-f81e3e8f40a0 req-a2cf7da4-39e1-49a6-b5dd-f1c75c04222d service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Received event network-vif-plugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-423be419-f6a4-4813-9489-f81e3e8f40a0 req-a2cf7da4-39e1-49a6-b5dd-f1c75c04222d service nova] Acquiring lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-423be419-f6a4-4813-9489-f81e3e8f40a0 req-a2cf7da4-39e1-49a6-b5dd-f1c75c04222d service nova] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-423be419-f6a4-4813-9489-f81e3e8f40a0 req-a2cf7da4-39e1-49a6-b5dd-f1c75c04222d service nova] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-423be419-f6a4-4813-9489-f81e3e8f40a0 req-a2cf7da4-39e1-49a6-b5dd-f1c75c04222d service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] No waiting events found dispatching network-vif-plugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:35:49 user nova-compute[75993]: WARNING nova.compute.manager [req-423be419-f6a4-4813-9489-f81e3e8f40a0 req-a2cf7da4-39e1-49a6-b5dd-f1c75c04222d service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Received unexpected event network-vif-plugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 for instance with vm_state building and task_state spawning.
Nov 08 21:35:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:49 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Instance destroyed successfully.
Nov 08 21:35:49 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Attempting rescue
Nov 08 21:35:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75993) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Instance directory exists: not creating {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 21:35:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Creating image(s)
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.objects.instance [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'trusted_certs' on Instance uuid e7d6503c-765f-4652-8865-e6494e6f58d2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:35:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Instance spawned successfully.
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:50 user nova-compute[75993]: INFO nova.compute.manager [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Took 6.42 seconds to spawn the instance on the hypervisor.
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue" returned: 0 in 0.059s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.objects.instance [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'migration_context' on Instance uuid e7d6503c-765f-4652-8865-e6494e6f58d2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.objects.base [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<e7d6503c-765f-4652-8865-e6494e6f58d2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Start _get_guest_xml network_info=[{"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "vif_mac": "fa:16:3e:fc:64:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.objects.instance [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'resources' on Instance uuid e7d6503c-765f-4652-8865-e6494e6f58d2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.objects.base [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<e7d6503c-765f-4652-8865-e6494e6f58d2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.objects.instance [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'numa_topology' on Instance uuid e7d6503c-765f-4652-8865-e6494e6f58d2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:35:50 user nova-compute[75993]: INFO nova.compute.manager [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Took 7.34 seconds to build instance.
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.objects.base [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<e7d6503c-765f-4652-8865-e6494e6f58d2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:35:50 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:35:50 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7e817d7e-c548-4467-9fed-ebcdd61003ee tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.462s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.objects.instance [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'vcpu_model' on Instance uuid e7d6503c-765f-4652-8865-e6494e6f58d2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.objects.base [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<e7d6503c-765f-4652-8865-e6494e6f58d2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1971321515',display_name='tempest-ServerRescueNegativeTestJSON-server-1971321515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1971321515',id=2,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-ir161ktw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:16Z,user_data=None,user_id='37e02c3f49f1467498623a47a979a65d',uuid=e7d6503c-765f-4652-8865-e6494e6f58d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "vif_mac": "fa:16:3e:fc:64:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "vif_mac": "fa:16:3e:fc:64:c6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:64:c6,bridge_name='br-int',has_traffic_filtering=True,id=bc9ca8a3-f4c5-4268-b587-dd6e8103ba02,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9ca8a3-f4') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.objects.instance [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'pci_devices' on Instance uuid e7d6503c-765f-4652-8865-e6494e6f58d2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.objects.base [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<e7d6503c-765f-4652-8865-e6494e6f58d2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:35:50 user nova-compute[75993]:   <uuid>e7d6503c-765f-4652-8865-e6494e6f58d2</uuid>
Nov 08 21:35:50 user nova-compute[75993]:   <name>instance-00000002</name>
Nov 08 21:35:50 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:35:50 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:35:50 user nova-compute[75993]:   <metadata>
Nov 08 21:35:50 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:35:50 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:35:50 user nova-compute[75993]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1971321515</nova:name>
Nov 08 21:35:50 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:35:50</nova:creationTime>
Nov 08 21:35:50 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:35:50 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:35:50 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:35:50 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:35:50 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:35:50 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:35:50 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:35:50 user nova-compute[75993]:       <nova:owner>
Nov 08 21:35:50 user nova-compute[75993]:         <nova:user uuid="37e02c3f49f1467498623a47a979a65d">tempest-ServerRescueNegativeTestJSON-1699992008-project-member</nova:user>
Nov 08 21:35:50 user nova-compute[75993]:         <nova:project uuid="b1b3b0aa87ce49949be27025c497a432">tempest-ServerRescueNegativeTestJSON-1699992008</nova:project>
Nov 08 21:35:50 user nova-compute[75993]:       </nova:owner>
Nov 08 21:35:50 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:35:50 user nova-compute[75993]:       <nova:ports>
Nov 08 21:35:50 user nova-compute[75993]:         <nova:port uuid="bc9ca8a3-f4c5-4268-b587-dd6e8103ba02">
Nov 08 21:35:50 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 21:35:50 user nova-compute[75993]:         </nova:port>
Nov 08 21:35:50 user nova-compute[75993]:       </nova:ports>
Nov 08 21:35:50 user nova-compute[75993]:     </nova:instance>
Nov 08 21:35:50 user nova-compute[75993]:   </metadata>
Nov 08 21:35:50 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:35:50 user nova-compute[75993]:     <system>
Nov 08 21:35:50 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:35:50 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:35:50 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:35:50 user nova-compute[75993]:       <entry name="serial">e7d6503c-765f-4652-8865-e6494e6f58d2</entry>
Nov 08 21:35:50 user nova-compute[75993]:       <entry name="uuid">e7d6503c-765f-4652-8865-e6494e6f58d2</entry>
Nov 08 21:35:50 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:35:50 user nova-compute[75993]:     </system>
Nov 08 21:35:50 user nova-compute[75993]:   </sysinfo>
Nov 08 21:35:50 user nova-compute[75993]:   <os>
Nov 08 21:35:50 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:35:50 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:35:50 user nova-compute[75993]:   </os>
Nov 08 21:35:50 user nova-compute[75993]:   <features>
Nov 08 21:35:50 user nova-compute[75993]:     <acpi/>
Nov 08 21:35:50 user nova-compute[75993]:     <apic/>
Nov 08 21:35:50 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:35:50 user nova-compute[75993]:   </features>
Nov 08 21:35:50 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:35:50 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:35:50 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:35:50 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:35:50 user nova-compute[75993]:   </clock>
Nov 08 21:35:50 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:35:50 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:35:50 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:35:50 user nova-compute[75993]:   </cpu>
Nov 08 21:35:50 user nova-compute[75993]:   <devices>
Nov 08 21:35:50 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:35:50 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:35:50 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue"/>
Nov 08 21:35:50 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:35:50 user nova-compute[75993]:     </disk>
Nov 08 21:35:50 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:35:50 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:35:50 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk"/>
Nov 08 21:35:50 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:35:50 user nova-compute[75993]:     </disk>
Nov 08 21:35:50 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:35:50 user nova-compute[75993]:       <mac address="fa:16:3e:fc:64:c6"/>
Nov 08 21:35:50 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:35:50 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:35:50 user nova-compute[75993]:       <target dev="tapbc9ca8a3-f4"/>
Nov 08 21:35:50 user nova-compute[75993]:     </interface>
Nov 08 21:35:50 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:35:50 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/console.log" append="off"/>
Nov 08 21:35:50 user nova-compute[75993]:     </serial>
Nov 08 21:35:50 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:35:50 user nova-compute[75993]:     <video>
Nov 08 21:35:50 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:35:50 user nova-compute[75993]:     </video>
Nov 08 21:35:50 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:35:50 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:35:50 user nova-compute[75993]:     </rng>
Nov 08 21:35:50 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:35:50 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:35:50 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:35:50 user nova-compute[75993]:     </memballoon>
Nov 08 21:35:50 user nova-compute[75993]:   </devices>
Nov 08 21:35:50 user nova-compute[75993]: </domain>
Nov 08 21:35:50 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:35:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Instance destroyed successfully.
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No VIF found with MAC fa:16:3e:fc:64:c6, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:35:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] No waiting events found dispatching network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:35:51 user nova-compute[75993]: WARNING nova.compute.manager [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received unexpected event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 for instance with vm_state active and task_state rescuing.
Nov 08 21:35:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:35:51 user nova-compute[75993]: WARNING nova.compute.manager [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received unexpected event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a for instance with vm_state building and task_state spawning.
Nov 08 21:35:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:35:51 user nova-compute[75993]: WARNING nova.compute.manager [req-195544b3-e7a5-4c91-b470-4d3907f152ee req-eeaf676a-f2fa-42f3-956d-1d97968a8ade service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received unexpected event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a for instance with vm_state building and task_state spawning.
Nov 08 21:35:51 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Updating instance_info_cache with network_info: [{"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:51 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:35:52 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Instance spawned successfully.
Nov 08 21:35:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:35:52 user nova-compute[75993]: INFO nova.compute.manager [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 08 21:35:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:35:52 user nova-compute[75993]: INFO nova.compute.manager [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Took 34.31 seconds to build instance.
Nov 08 21:35:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e0acbff3-79ad-4bcc-86fe-24f43a055edc tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.513s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:53 user nova-compute[75993]: DEBUG nova.compute.manager [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:53 user nova-compute[75993]: DEBUG nova.compute.manager [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] No waiting events found dispatching network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:35:53 user nova-compute[75993]: WARNING nova.compute.manager [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received unexpected event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 for instance with vm_state active and task_state rescuing.
Nov 08 21:35:53 user nova-compute[75993]: DEBUG nova.compute.manager [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:53 user nova-compute[75993]: DEBUG nova.compute.manager [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] No waiting events found dispatching network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:35:53 user nova-compute[75993]: WARNING nova.compute.manager [req-20314be9-b5ca-4fc9-9b65-63f487e8d4ba req-64dec729-043a-4725-96a4-2a4e9fe4a3b4 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received unexpected event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 for instance with vm_state active and task_state rescuing.
Nov 08 21:35:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-31ed43aa-0223-4195-8c45-e42bf629c08d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lazy-loading 'flavor' on Instance uuid a10c0a9d-5398-43db-8589-6e0763d7c5e8 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.216s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.344s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.005s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:35:56 user nova-compute[75993]: INFO nova.compute.manager [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Attaching volume 01959ef0-5a3f-40eb-9deb-fd064d5a16a4 to /dev/vdb
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.335s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-dde0eac3-50a3-43a6-b715-38ea69f01083 req-e4f655c7-6a13-44d3-9fe1-5820bb3aec86 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-changed-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-dde0eac3-50a3-43a6-b715-38ea69f01083 req-e4f655c7-6a13-44d3-9fe1-5820bb3aec86 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Refreshing instance network info cache due to event network-changed-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dde0eac3-50a3-43a6-b715-38ea69f01083 req-e4f655c7-6a13-44d3-9fe1-5820bb3aec86 service nova] Acquiring lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dde0eac3-50a3-43a6-b715-38ea69f01083 req-e4f655c7-6a13-44d3-9fe1-5820bb3aec86 service nova] Acquired lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG nova.network.neutron [req-dde0eac3-50a3-43a6-b715-38ea69f01083 req-e4f655c7-6a13-44d3-9fe1-5820bb3aec86 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Refreshing network info cache for port 8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG os_brick.utils [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[859fd16c-0164-4ff6-967f-1d2e29ee629c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d399099-43c0-4898-a8d9-10f530a3ecbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1a6c48-f964-46b6-912e-9af89f48293b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8565e828-5241-40dd-b3cc-88470e21a7ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:35:56 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75bba31-f171-4e13-9848-07061d62cf78]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG os_brick.utils [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Updating existing volume attachment record: 37f41dc2-4d11-48f1-9fc2-f5988d61c8fd {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:57 user nova-compute[75993]: DEBUG nova.network.neutron [req-dde0eac3-50a3-43a6-b715-38ea69f01083 req-e4f655c7-6a13-44d3-9fe1-5820bb3aec86 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updated VIF entry in instance network info cache for port 8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:35:57 user nova-compute[75993]: DEBUG nova.network.neutron [req-dde0eac3-50a3-43a6-b715-38ea69f01083 req-e4f655c7-6a13-44d3-9fe1-5820bb3aec86 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updating instance_info_cache with network_info: [{"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:35:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dde0eac3-50a3-43a6-b715-38ea69f01083 req-e4f655c7-6a13-44d3-9fe1-5820bb3aec86 service nova] Releasing lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:35:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:35:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:35:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:35:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:35:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.255s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:36:00 user nova-compute[75993]: INFO nova.compute.claims [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Claim successful on node user
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "81c8325d-776c-4171-86eb-26f83b7dde00" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:01 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:36:01 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:36:01 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7235MB free_disk=25.529800415039062GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:36:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:01 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:36:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:01 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:36:01 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:36:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.323s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:01 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:36:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.278s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:36:02 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 35ca9fea-481a-42ac-8558-c5140e71de59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f0d20870-4544-428f-8963-4e358845514c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance c68ac7dc-3b4f-4d34-946d-86e8726c38af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: INFO nova.virt.block_device [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Booting with volume 878fed90-8eac-4987-9bd7-bf3aa880998d at /dev/vda
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 81c8325d-776c-4171-86eb-26f83b7dde00 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1299c29d-4c41-43c5-ad63-7eae393065d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d5c049a3-6f20-49d4-90df-e0222c2fdc8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9bb5a995-4872-4671-91ab-ca0127d65181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance a10c0a9d-5398-43db-8589-6e0763d7c5e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1a014eaf-7813-445b-b783-282ea30f034c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.policy [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6147fd63937f48389f54a418c8ba2a21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e556b7998d44018428c2753f5d22df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG os_brick.utils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f1fe30-ca49-486b-9738-1d83c161d0b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef86db52-5a88-45d0-9aa6-034f984aa049]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cd8f3e-0acf-4937-b0ff-a6a3619c317a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f65625a-658d-4922-9317-081dd0aedd43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:02 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e0370f-1bbf-401f-b94d-2dd52dd5bf05]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG os_brick.utils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating existing volume attachment record: c53aa686-236f-4688-8e46-c92d86d47479 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.990s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.148s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:02 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:36:02 user nova-compute[75993]: INFO nova.compute.claims [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Claim successful on node user
Nov 08 21:36:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:03 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully created port: 8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:36:03 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:36:03 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:36:03 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:36:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.641s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:03 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:36:03 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:36:03 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:36:03 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:36:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:36:04 user nova-compute[75993]: INFO nova.virt.block_device [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Booting with volume 3c928c86-706a-45a0-8855-74e227ade451 at /dev/vda
Nov 08 21:36:04 user nova-compute[75993]: DEBUG os_brick.utils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedbb81d-7468-4151-9c42-26556a5b57f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[436adb8f-8032-4369-98f9-199f4cca5b6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d1f082-7b6c-4082-a9e0-8f55d6574421]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0608374-c508-4c91-8729-f23e0d9c5964]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG nova.policy [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dbe48f7d4a2741eb8c641ff677ef7895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a11b5afb90b443f9a283b21bacbc822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:04 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:36:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[81277599-fe7d-4b2b-a450-0d116ffcb7b8]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG os_brick.utils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:04 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating existing volume attachment record: 324fb985-90b0-4cd9-a9bb-19317d144ae2 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:36:05 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully created port: 64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:36:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:05 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully created port: be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:36:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-d538037e-7db6-47bb-9fa2-485def778a5a req-5e1a6fb7-35e2-4dbf-ae65-363456b2888b service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Received event network-changed-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-d538037e-7db6-47bb-9fa2-485def778a5a req-5e1a6fb7-35e2-4dbf-ae65-363456b2888b service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Refreshing instance network info cache due to event network-changed-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d538037e-7db6-47bb-9fa2-485def778a5a req-5e1a6fb7-35e2-4dbf-ae65-363456b2888b service nova] Acquiring lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d538037e-7db6-47bb-9fa2-485def778a5a req-5e1a6fb7-35e2-4dbf-ae65-363456b2888b service nova] Acquired lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:05 user nova-compute[75993]: DEBUG nova.network.neutron [req-d538037e-7db6-47bb-9fa2-485def778a5a req-5e1a6fb7-35e2-4dbf-ae65-363456b2888b service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Refreshing network info cache for port 81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:06 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully created port: e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:36:06 user nova-compute[75993]: DEBUG nova.network.neutron [req-d538037e-7db6-47bb-9fa2-485def778a5a req-5e1a6fb7-35e2-4dbf-ae65-363456b2888b service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Updated VIF entry in instance network info cache for port 81a8f9a5-5955-4ba0-89fb-47a5c3328a3b. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:36:06 user nova-compute[75993]: DEBUG nova.network.neutron [req-d538037e-7db6-47bb-9fa2-485def778a5a req-5e1a6fb7-35e2-4dbf-ae65-363456b2888b service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Updating instance_info_cache with network_info: [{"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d538037e-7db6-47bb-9fa2-485def778a5a req-5e1a6fb7-35e2-4dbf-ae65-363456b2888b service nova] Releasing lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:06 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully created port: 73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:36:07 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully created port: bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:36:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully created port: 3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:36:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully created port: a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:36:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully created port: 6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:36:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully updated port: 8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-88e38e5c-007f-4fbd-bd01-e2d99c0660c4 req-08024a66-737a-4cda-a699-159204c51b00 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-changed-8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-88e38e5c-007f-4fbd-bd01-e2d99c0660c4 req-08024a66-737a-4cda-a699-159204c51b00 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing instance network info cache due to event network-changed-8061d712-84a3-4484-9af3-7a721ba39201. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-88e38e5c-007f-4fbd-bd01-e2d99c0660c4 req-08024a66-737a-4cda-a699-159204c51b00 service nova] Acquiring lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-88e38e5c-007f-4fbd-bd01-e2d99c0660c4 req-08024a66-737a-4cda-a699-159204c51b00 service nova] Acquired lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:09 user nova-compute[75993]: DEBUG nova.network.neutron [req-88e38e5c-007f-4fbd-bd01-e2d99c0660c4 req-08024a66-737a-4cda-a699-159204c51b00 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing network info cache for port 8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:10 user nova-compute[75993]: DEBUG nova.network.neutron [req-88e38e5c-007f-4fbd-bd01-e2d99c0660c4 req-08024a66-737a-4cda-a699-159204c51b00 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:10 user nova-compute[75993]: DEBUG nova.network.neutron [req-88e38e5c-007f-4fbd-bd01-e2d99c0660c4 req-08024a66-737a-4cda-a699-159204c51b00 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-88e38e5c-007f-4fbd-bd01-e2d99c0660c4 req-08024a66-737a-4cda-a699-159204c51b00 service nova] Releasing lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:10 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully created port: d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:36:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully updated port: d4d60025-cd29-4e1d-a98c-d4c6e222914f {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully updated port: be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-changed-d4d60025-cd29-4e1d-a98c-d4c6e222914f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing instance network info cache due to event network-changed-d4d60025-cd29-4e1d-a98c-d4c6e222914f. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] Acquiring lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] Acquired lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG nova.network.neutron [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing network info cache for port d4d60025-cd29-4e1d-a98c-d4c6e222914f {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG nova.network.neutron [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG nova.network.neutron [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] Releasing lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-changed-be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing instance network info cache due to event network-changed-be74d5f7-6805-471f-8295-c60479f28e95. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] Acquiring lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] Acquired lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG nova.network.neutron [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing network info cache for port be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:12 user nova-compute[75993]: DEBUG nova.network.neutron [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:13 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully updated port: 03bc5876-9344-412e-b868-0efe6d1a2b87 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:13 user nova-compute[75993]: DEBUG nova.network.neutron [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a4c9ac4d-f33d-4896-ade7-9e4ccb33e6ac req-2459420b-97bf-4e77-8e58-ee8bdc393fbb service nova] Releasing lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:13 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully updated port: 973638d8-8c22-4d53-9354-277bb212f9a0 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:14 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully updated port: 64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-changed-03bc5876-9344-412e-b868-0efe6d1a2b87 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing instance network info cache due to event network-changed-03bc5876-9344-412e-b868-0efe6d1a2b87. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] Acquiring lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] Acquired lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:14 user nova-compute[75993]: DEBUG nova.network.neutron [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing network info cache for port 03bc5876-9344-412e-b868-0efe6d1a2b87 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:14 user nova-compute[75993]: DEBUG nova.network.neutron [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] Releasing lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-changed-973638d8-8c22-4d53-9354-277bb212f9a0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing instance network info cache due to event network-changed-973638d8-8c22-4d53-9354-277bb212f9a0. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] Acquiring lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] Acquired lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing network info cache for port 973638d8-8c22-4d53-9354-277bb212f9a0 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully updated port: 65d1813e-7468-4b8f-b601-919421486512 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] Releasing lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-changed-64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing instance network info cache due to event network-changed-64c7f448-31f1-4983-8137-35563482e00c. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] Acquiring lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] Acquired lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing network info cache for port 64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-8b4cd230-ede4-4916-aaf8-8b8d1899d107 req-33867437-b116-4bb9-a6ad-474b7d7127be service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-changed-65d1813e-7468-4b8f-b601-919421486512 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-8b4cd230-ede4-4916-aaf8-8b8d1899d107 req-33867437-b116-4bb9-a6ad-474b7d7127be service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing instance network info cache due to event network-changed-65d1813e-7468-4b8f-b601-919421486512. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8b4cd230-ede4-4916-aaf8-8b8d1899d107 req-33867437-b116-4bb9-a6ad-474b7d7127be service nova] Acquiring lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8b4cd230-ede4-4916-aaf8-8b8d1899d107 req-33867437-b116-4bb9-a6ad-474b7d7127be service nova] Acquired lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG nova.network.neutron [req-8b4cd230-ede4-4916-aaf8-8b8d1899d107 req-33867437-b116-4bb9-a6ad-474b7d7127be service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing network info cache for port 65d1813e-7468-4b8f-b601-919421486512 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG nova.network.neutron [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57f14f1a-047d-4364-8e94-dc0703e12fc0 req-253f2bb1-6429-48ab-9628-67fd8c4d60bd service nova] Releasing lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully updated port: e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-54dd2b33-7cc4-4c51-950a-f0c562ad4e4b req-24b8e55f-685b-42cd-96a9-f5f455ca46b9 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Received event network-changed-77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-54dd2b33-7cc4-4c51-950a-f0c562ad4e4b req-24b8e55f-685b-42cd-96a9-f5f455ca46b9 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Refreshing instance network info cache due to event network-changed-77583e50-3625-4e95-aaa6-b6b9336e3cd0. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54dd2b33-7cc4-4c51-950a-f0c562ad4e4b req-24b8e55f-685b-42cd-96a9-f5f455ca46b9 service nova] Acquiring lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54dd2b33-7cc4-4c51-950a-f0c562ad4e4b req-24b8e55f-685b-42cd-96a9-f5f455ca46b9 service nova] Acquired lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG nova.network.neutron [req-54dd2b33-7cc4-4c51-950a-f0c562ad4e4b req-24b8e55f-685b-42cd-96a9-f5f455ca46b9 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Refreshing network info cache for port 77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG nova.network.neutron [req-8b4cd230-ede4-4916-aaf8-8b8d1899d107 req-33867437-b116-4bb9-a6ad-474b7d7127be service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG nova.network.neutron [req-8b4cd230-ede4-4916-aaf8-8b8d1899d107 req-33867437-b116-4bb9-a6ad-474b7d7127be service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8b4cd230-ede4-4916-aaf8-8b8d1899d107 req-33867437-b116-4bb9-a6ad-474b7d7127be service nova] Releasing lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:16 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully updated port: 73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:17 user nova-compute[75993]: DEBUG nova.network.neutron [req-54dd2b33-7cc4-4c51-950a-f0c562ad4e4b req-24b8e55f-685b-42cd-96a9-f5f455ca46b9 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Updated VIF entry in instance network info cache for port 77583e50-3625-4e95-aaa6-b6b9336e3cd0. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:36:17 user nova-compute[75993]: DEBUG nova.network.neutron [req-54dd2b33-7cc4-4c51-950a-f0c562ad4e4b req-24b8e55f-685b-42cd-96a9-f5f455ca46b9 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Updating instance_info_cache with network_info: [{"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54dd2b33-7cc4-4c51-950a-f0c562ad4e4b req-24b8e55f-685b-42cd-96a9-f5f455ca46b9 service nova] Releasing lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:17 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully updated port: bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully updated port: 3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-changed-e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing instance network info cache due to event network-changed-e8c4fb3e-981c-45b4-9ed3-cea1605128fb. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Acquiring lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Acquired lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing network info cache for port e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Releasing lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-changed-73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing instance network info cache due to event network-changed-73dee529-8844-464d-8f84-9f9abd1f77b3. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Acquiring lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Acquired lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:18 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing network info cache for port 73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Releasing lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-changed-bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing instance network info cache due to event network-changed-bf50bddc-3f74-4d9e-9003-e8075806a131. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Acquiring lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Acquired lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing network info cache for port bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Successfully updated port: a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:19 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully updated port: 6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Releasing lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-changed-3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing instance network info cache due to event network-changed-3824792e-3b3f-42e8-88de-ea963abd8625. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Acquiring lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Acquired lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing network info cache for port 3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquired lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-changed-a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing instance network info cache due to event network-changed-a4197c5a-1660-4d86-97ce-ac19cbc419a9. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] Acquiring lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG nova.network.neutron [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-829259ea-ad2b-40c4-a157-73a51166a83b req-ad445932-fddd-46dc-9daf-f9b5c0c9e7d6 service nova] Releasing lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:21 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Successfully updated port: d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquired lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:21 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:36:21 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:36:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-306b2668-0a3c-478d-ac68-870ad68c0d1d req-74b5977b-03e2-4744-9937-c7a9ec40f51f service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-changed-d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-306b2668-0a3c-478d-ac68-870ad68c0d1d req-74b5977b-03e2-4744-9937-c7a9ec40f51f service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing instance network info cache due to event network-changed-d412b0c6-d5b0-4227-a40b-c6747d39448b. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-306b2668-0a3c-478d-ac68-870ad68c0d1d req-74b5977b-03e2-4744-9937-c7a9ec40f51f service nova] Acquiring lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-c37badfd-d957-40d5-8dbf-9af80b845d57 req-d0ba705f-2c3f-497c-963f-1020c80b4cc9 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-changed-d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-c37badfd-d957-40d5-8dbf-9af80b845d57 req-d0ba705f-2c3f-497c-963f-1020c80b4cc9 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Refreshing instance network info cache due to event network-changed-d05110a2-8c3f-492e-8f02-77d7e07983cb. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c37badfd-d957-40d5-8dbf-9af80b845d57 req-d0ba705f-2c3f-497c-963f-1020c80b4cc9 service nova] Acquiring lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c37badfd-d957-40d5-8dbf-9af80b845d57 req-d0ba705f-2c3f-497c-963f-1020c80b4cc9 service nova] Acquired lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:22 user nova-compute[75993]: DEBUG nova.network.neutron [req-c37badfd-d957-40d5-8dbf-9af80b845d57 req-d0ba705f-2c3f-497c-963f-1020c80b4cc9 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Refreshing network info cache for port d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "interface-c68ac7dc-3b4f-4d34-946d-86e8726c38af-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "interface-c68ac7dc-3b4f-4d34-946d-86e8726c38af-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.objects.instance [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lazy-loading 'flavor' on Instance uuid c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.objects.instance [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lazy-loading 'pci_requests' on Instance uuid c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.objects.base [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Object Instance<c68ac7dc-3b4f-4d34-946d-86e8726c38af> lazy-loaded attributes: flavor,pci_requests {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.network.neutron [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.policy [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b13e1fc5636403f88aee213e6d70e7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3144772c95b74eecbd2a1781114cfb77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-c37badfd-d957-40d5-8dbf-9af80b845d57 req-d0ba705f-2c3f-497c-963f-1020c80b4cc9 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updated VIF entry in instance network info cache for port d05110a2-8c3f-492e-8f02-77d7e07983cb. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-c37badfd-d957-40d5-8dbf-9af80b845d57 req-d0ba705f-2c3f-497c-963f-1020c80b4cc9 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updating instance_info_cache with network_info: [{"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnJxlEfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:23 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:36:23 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:36:23 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c37badfd-d957-40d5-8dbf-9af80b845d57 req-d0ba705f-2c3f-497c-963f-1020c80b4cc9 service nova] Releasing lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cf462a-d68f-4108-a42b-f888e1437a44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:36:23 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfccebed-ecba-4ccc-a040-e3bfca634435]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4] added
Nov 08 21:36:23 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3b0d1c-cfd3-429b-b939-d9e14391236b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f861b1c0-3481-499c-9b66-0a6b56f9fa12]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnJxlEfS {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.objects.instance [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'flavor' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qnJxlEfS" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[50399309-ffa3-45b9-93e2-17802dd963dd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qnJxlEfS'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb93faa-8330-43f0-be58-a4b79d9418ac]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [{"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf50bddc-3f74-4d9e-9003-e8075806a131", "address": "fa:16:3e:5e:15:67", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf50bddc-3f", "ovs_interfaceid": "bf50bddc-3f74-4d9e-9003-e8075806a131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7482eca-f64d-4c91-9099-1d546960d1f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:23 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:23 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Releasing lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Instance network_info: |[{"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf50bddc-3f74-4d9e-9003-e8075806a131", "address": "fa:16:3e:5e:15:67", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf50bddc-3f", "ovs_interfaceid": "bf50bddc-3f74-4d9e-9003-e8075806a131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] Acquired lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing network info cache for port a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.148s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[da594cca-8f4f-48c5-92b3-f3835882fa78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4, portal: 172.16.0.220,3260]
Nov 08 21:36:24 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4, portal: 172.16.0.220,3260] successful.
Nov 08 21:36:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fde1e4d-2868-4825-a5c6-a44257fca4e1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[78696fc3-e0fb-4756-abf0-3bd712594e34]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:24 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:24 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f9e004-2fa7-49c1-843f-f84bd6d4884e]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnJxlEfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.network.neutron [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Successfully created port: 21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lazy-loading 'flavor' on Instance uuid f0d20870-4544-428f-8963-4e358845514c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:24 user nova-compute[75993]: INFO nova.compute.manager [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Attaching volume e2ab3823-e622-43bb-8f66-0e85981a3e24 to /dev/vdb
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:24 user nova-compute[75993]: INFO nova.compute.manager [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Attaching volume 88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf to /dev/vdb
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.utils [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[717043eb-fb68-4c62-a053-98f3e38046bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f54c107-93b6-42e3-ace6-0ac5ff5ae6fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.utils [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aad529a-aec5-48bb-a5cb-4ff307934548]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a79d30-3aad-4e1b-abf1-05ef82647692]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6988b8d6-93d0-4254-b5de-46099d46d571]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.network.neutron [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updated VIF entry in instance network info cache for port a4197c5a-1660-4d86-97ce-ac19cbc419a9. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.network.neutron [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [{"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf50bddc-3f74-4d9e-9003-e8075806a131", "address": "fa:16:3e:5e:15:67", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf50bddc-3f", "ovs_interfaceid": "bf50bddc-3f74-4d9e-9003-e8075806a131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[63620e46-66d3-4b84-bde4-b952980e1f60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:24 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[004a254d-3590-4442-8fb7-149f3ce6294c]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] Releasing lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-changed-6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing instance network info cache due to event network-changed-6c5e3135-2e49-4589-8f5c-dd9c75622f91. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] Acquiring lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.utils [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updating existing volume attachment record: 83b53332-da14-4b93-ab40-ddf5b5bd4dfd {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79ed8df-0538-46bc-a551-87d877b1c5a3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea96edd7-144e-48bd-9a8a-52395df131bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.network.neutron [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Successfully updated port: 21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquired lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.network.neutron [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:24 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[200206af-a773-41b0-af08-28a7da9db1ce]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG os_brick.utils [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] <== get_connector_properties: return (236ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Updating existing volume attachment record: f42f14b2-7dd8-4969-9c62-dc76a1f3b8da {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-7bc53fdd-816d-4927-abbb-5dc9c072cfcc req-e1a715db-51d7-42c7-9fda-7f576463f9df service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-changed-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-7bc53fdd-816d-4927-abbb-5dc9c072cfcc req-e1a715db-51d7-42c7-9fda-7f576463f9df service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Refreshing instance network info cache due to event network-changed-21e2ed5b-c9b3-42f2-b19b-26fdb450de38. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7bc53fdd-816d-4927-abbb-5dc9c072cfcc req-e1a715db-51d7-42c7-9fda-7f576463f9df service nova] Acquiring lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23238626436343932', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238626436343932', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lazy-loading 'flavor' on Instance uuid a10c0a9d-5398-43db-8589-6e0763d7c5e8 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:36:25 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:36:25 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 21:36:25 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:36:25 user nova-compute[75993]:   <serial>01959ef0-5a3f-40eb-9deb-fd064d5a16a4</serial>
Nov 08 21:36:25 user nova-compute[75993]: </disk>
Nov 08 21:36:25 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [{"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Releasing lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Instance network_info: |[{"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-306b2668-0a3c-478d-ac68-870ad68c0d1d req-74b5977b-03e2-4744-9937-c7a9ec40f51f service nova] Acquired lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-306b2668-0a3c-478d-ac68-870ad68c0d1d req-74b5977b-03e2-4744-9937-c7a9ec40f51f service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing network info cache for port d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG nova.network.neutron [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updating instance_info_cache with network_info: [{"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Releasing lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7bc53fdd-816d-4927-abbb-5dc9c072cfcc req-e1a715db-51d7-42c7-9fda-7f576463f9df service nova] Acquired lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-7bc53fdd-816d-4927-abbb-5dc9c072cfcc req-e1a715db-51d7-42c7-9fda-7f576463f9df service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Refreshing network info cache for port 21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686990095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686990095',id=7,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIYNlWsNYNXIPzYxHJHsqWLqulGXulk0Teiy9wHphwJUB1UKtAxuCAT9/nMP58cJKIagHsE3mNVjHBFc2GKI4Bsmrn42N0sgHxg9hFcGJDRyLkXho/6LRS6t4SoMazlhg==',key_name='tempest-keypair-1407039979',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3144772c95b74eecbd2a1781114cfb77',ramdisk_id='',reservation_id='r-5deny31q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487427237',owner_user_name='tempest-TaggedAttachmentsTest-1487427237-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b13e1fc5636403f88aee213e6d70e7d',uuid=c68ac7dc-3b4f-4d34-946d-86e8726c38af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converting VIF {"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG os_vif [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92195e59-3f80-5a98-9d78-6a14821072c9', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21e2ed5b-c9, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21e2ed5b-c9, col_values=(('qos', UUID('6c93d268-1fbd-4c87-957d-9d50487a0361')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21e2ed5b-c9, col_values=(('external_ids', {'iface-id': '21e2ed5b-c9b3-42f2-b19b-26fdb450de38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:2f:f0', 'vm-uuid': 'c68ac7dc-3b4f-4d34-946d-86e8726c38af'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:26 user nova-compute[75993]: INFO os_vif [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9')
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686990095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686990095',id=7,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIYNlWsNYNXIPzYxHJHsqWLqulGXulk0Teiy9wHphwJUB1UKtAxuCAT9/nMP58cJKIagHsE3mNVjHBFc2GKI4Bsmrn42N0sgHxg9hFcGJDRyLkXho/6LRS6t4SoMazlhg==',key_name='tempest-keypair-1407039979',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3144772c95b74eecbd2a1781114cfb77',ramdisk_id='',reservation_id='r-5deny31q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487427237',owner_user_name='tempest-TaggedAttachmentsTest-1487427237-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b13e1fc5636403f88aee213e6d70e7d',uuid=c68ac7dc-3b4f-4d34-946d-86e8726c38af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converting VIF {"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] attach device xml: <interface type="ethernet">
Nov 08 21:36:26 user nova-compute[75993]:   <mac address="fa:16:3e:b7:2f:f0"/>
Nov 08 21:36:26 user nova-compute[75993]:   <model type="virtio"/>
Nov 08 21:36:26 user nova-compute[75993]:   <mtu size="1442"/>
Nov 08 21:36:26 user nova-compute[75993]:   <target dev="tap21e2ed5b-c9"/>
Nov 08 21:36:26 user nova-compute[75993]: </interface>
Nov 08 21:36:26 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] No VIF found with MAC fa:16:3e:bb:b4:ce, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.network.neutron [req-306b2668-0a3c-478d-ac68-870ad68c0d1d req-74b5977b-03e2-4744-9937-c7a9ec40f51f service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updated VIF entry in instance network info cache for port d412b0c6-d5b0-4227-a40b-c6747d39448b. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.network.neutron [req-306b2668-0a3c-478d-ac68-870ad68c0d1d req-74b5977b-03e2-4744-9937-c7a9ec40f51f service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [{"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-306b2668-0a3c-478d-ac68-870ad68c0d1d req-74b5977b-03e2-4744-9937-c7a9ec40f51f service nova] Releasing lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] Acquired lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.network.neutron [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing network info cache for port 6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] No BDM found with device name hda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] No VIF found with MAC fa:16:3e:61:e1:be, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:36:26 user nova-compute[75993]:   <nova:package version="0.0.0"/>
Nov 08 21:36:26 user nova-compute[75993]:   <nova:name>tempest-device-tagging-server-686990095</nova:name>
Nov 08 21:36:26 user nova-compute[75993]:   <nova:creationTime>2023-11-08 21:36:26</nova:creationTime>
Nov 08 21:36:26 user nova-compute[75993]:   <nova:flavor name="m1.tiny">
Nov 08 21:36:26 user nova-compute[75993]:     <nova:memory>512</nova:memory>
Nov 08 21:36:26 user nova-compute[75993]:     <nova:disk>1</nova:disk>
Nov 08 21:36:26 user nova-compute[75993]:     <nova:swap>0</nova:swap>
Nov 08 21:36:26 user nova-compute[75993]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:36:26 user nova-compute[75993]:     <nova:vcpus>1</nova:vcpus>
Nov 08 21:36:26 user nova-compute[75993]:   </nova:flavor>
Nov 08 21:36:26 user nova-compute[75993]:   <nova:owner>
Nov 08 21:36:26 user nova-compute[75993]:     <nova:user uuid="6b13e1fc5636403f88aee213e6d70e7d">tempest-TaggedAttachmentsTest-1487427237-project-member</nova:user>
Nov 08 21:36:26 user nova-compute[75993]:     <nova:project uuid="3144772c95b74eecbd2a1781114cfb77">tempest-TaggedAttachmentsTest-1487427237</nova:project>
Nov 08 21:36:26 user nova-compute[75993]:   </nova:owner>
Nov 08 21:36:26 user nova-compute[75993]:   <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:36:26 user nova-compute[75993]:   <nova:ports>
Nov 08 21:36:26 user nova-compute[75993]:     <nova:port uuid="d05110a2-8c3f-492e-8f02-77d7e07983cb">
Nov 08 21:36:26 user nova-compute[75993]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 21:36:26 user nova-compute[75993]:     </nova:port>
Nov 08 21:36:26 user nova-compute[75993]:     <nova:port uuid="21e2ed5b-c9b3-42f2-b19b-26fdb450de38">
Nov 08 21:36:26 user nova-compute[75993]:       <nova:ip type="fixed" address="10.10.10.128" ipVersion="4"/>
Nov 08 21:36:26 user nova-compute[75993]:     </nova:port>
Nov 08 21:36:26 user nova-compute[75993]:   </nova:ports>
Nov 08 21:36:26 user nova-compute[75993]: </nova:instance>
Nov 08 21:36:26 user nova-compute[75993]:  {{(pid=75993) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bd827d72-7613-4bb1-99ff-6f268ed39c9f tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "interface-c68ac7dc-3b4f-4d34-946d-86e8726c38af-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.574s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.network.neutron [req-7bc53fdd-816d-4927-abbb-5dc9c072cfcc req-e1a715db-51d7-42c7-9fda-7f576463f9df service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updated VIF entry in instance network info cache for port 21e2ed5b-c9b3-42f2-b19b-26fdb450de38. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.network.neutron [req-7bc53fdd-816d-4927-abbb-5dc9c072cfcc req-e1a715db-51d7-42c7-9fda-7f576463f9df service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updating instance_info_cache with network_info: [{"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7bc53fdd-816d-4927-abbb-5dc9c072cfcc req-e1a715db-51d7-42c7-9fda-7f576463f9df service nova] Releasing lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.network.neutron [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updated VIF entry in instance network info cache for port 6c5e3135-2e49-4589-8f5c-dd9c75622f91. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:36:26 user nova-compute[75993]: DEBUG nova.network.neutron [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [{"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bca9035e-ad2a-42a6-a01e-458de88846d6 req-a3225124-c780-4779-a47a-b5205d6e4685 service nova] Releasing lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-8335f4c7-5e45-4016-b41b-a95ec1cb0b12 req-d04608eb-3a85-47e4-a51c-b575e4c38467 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-vif-plugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8335f4c7-5e45-4016-b41b-a95ec1cb0b12 req-d04608eb-3a85-47e4-a51c-b575e4c38467 service nova] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8335f4c7-5e45-4016-b41b-a95ec1cb0b12 req-d04608eb-3a85-47e4-a51c-b575e4c38467 service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8335f4c7-5e45-4016-b41b-a95ec1cb0b12 req-d04608eb-3a85-47e4-a51c-b575e4c38467 service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-8335f4c7-5e45-4016-b41b-a95ec1cb0b12 req-d04608eb-3a85-47e4-a51c-b575e4c38467 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] No waiting events found dispatching network-vif-plugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:36:27 user nova-compute[75993]: WARNING nova.compute.manager [req-8335f4c7-5e45-4016-b41b-a95ec1cb0b12 req-d04608eb-3a85-47e4-a51c-b575e4c38467 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received unexpected event network-vif-plugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 for instance with vm_state active and task_state None.
Nov 08 21:36:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-1c273621-96a9-43c0-8f13-6bf36abbd11c req-9e2b6070-eec8-4ffd-b30c-d1f4186f6714 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-vif-plugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1c273621-96a9-43c0-8f13-6bf36abbd11c req-9e2b6070-eec8-4ffd-b30c-d1f4186f6714 service nova] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1c273621-96a9-43c0-8f13-6bf36abbd11c req-9e2b6070-eec8-4ffd-b30c-d1f4186f6714 service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1c273621-96a9-43c0-8f13-6bf36abbd11c req-9e2b6070-eec8-4ffd-b30c-d1f4186f6714 service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-1c273621-96a9-43c0-8f13-6bf36abbd11c req-9e2b6070-eec8-4ffd-b30c-d1f4186f6714 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] No waiting events found dispatching network-vif-plugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:36:29 user nova-compute[75993]: WARNING nova.compute.manager [req-1c273621-96a9-43c0-8f13-6bf36abbd11c req-9e2b6070-eec8-4ffd-b30c-d1f4186f6714 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received unexpected event network-vif-plugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 for instance with vm_state active and task_state None.
Nov 08 21:36:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-e900a98e-dcee-4021-8bc4-3ece4a3e805e req-b8f9a253-30d6-4fb1-9738-31ad88c8def7 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Received event network-changed-cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-e900a98e-dcee-4021-8bc4-3ece4a3e805e req-b8f9a253-30d6-4fb1-9738-31ad88c8def7 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Refreshing instance network info cache due to event network-changed-cb94076d-a437-4177-a03e-5464dbf40fd9. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:36:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e900a98e-dcee-4021-8bc4-3ece4a3e805e req-b8f9a253-30d6-4fb1-9738-31ad88c8def7 service nova] Acquiring lock "refresh_cache-1a014eaf-7813-445b-b783-282ea30f034c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e900a98e-dcee-4021-8bc4-3ece4a3e805e req-b8f9a253-30d6-4fb1-9738-31ad88c8def7 service nova] Acquired lock "refresh_cache-1a014eaf-7813-445b-b783-282ea30f034c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:30 user nova-compute[75993]: DEBUG nova.network.neutron [req-e900a98e-dcee-4021-8bc4-3ece4a3e805e req-b8f9a253-30d6-4fb1-9738-31ad88c8def7 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Refreshing network info cache for port cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:36:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:30 user nova-compute[75993]: DEBUG nova.network.neutron [req-e900a98e-dcee-4021-8bc4-3ece4a3e805e req-b8f9a253-30d6-4fb1-9738-31ad88c8def7 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Updated VIF entry in instance network info cache for port cb94076d-a437-4177-a03e-5464dbf40fd9. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:36:30 user nova-compute[75993]: DEBUG nova.network.neutron [req-e900a98e-dcee-4021-8bc4-3ece4a3e805e req-b8f9a253-30d6-4fb1-9738-31ad88c8def7 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Updating instance_info_cache with network_info: [{"id": "cb94076d-a437-4177-a03e-5464dbf40fd9", "address": "fa:16:3e:3a:56:bd", "network": {"id": "635bf144-0bb5-4dad-9f1d-25aac4b8c0ad", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-506377129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7a786ab12104e738a7075f06f65b1ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb94076d-a4", "ovs_interfaceid": "cb94076d-a437-4177-a03e-5464dbf40fd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e900a98e-dcee-4021-8bc4-3ece4a3e805e req-b8f9a253-30d6-4fb1-9738-31ad88c8def7 service nova] Releasing lock "refresh_cache-1a014eaf-7813-445b-b783-282ea30f034c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:36:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:36:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-a10c0a9d-5398-43db-8589-6e0763d7c5e8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:36:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-a10c0a9d-5398-43db-8589-6e0763d7c5e8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:36:45 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:36:46 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Updating instance_info_cache with network_info: [{"id": "1b82dac2-8540-49cd-88c9-1793a988574d", "address": "fa:16:3e:bb:b4:ce", "network": {"id": "9b94f568-ddd0-4c23-a4d8-eabfca7dab83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1551524033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1951e152e794a0bb0d79af1c933c4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b82dac2-85", "ovs_interfaceid": "1b82dac2-8540-49cd-88c9-1793a988574d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-a10c0a9d-5398-43db-8589-6e0763d7c5e8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:36:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:36:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:36:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:36:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:36:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:36:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:36:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:36:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:36:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:54 user nova-compute[75993]: INFO nova.virt.block_device [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Booting with volume abd64a7d-2eb8-498d-996d-53642e92234a at /dev/vdb
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3eb704e3-41b2-4304-8a93-907ee3650ba6 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 58.163s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLDoRSAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:54 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:36:54 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:36:54 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.objects.instance [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lazy-loading 'flavor' on Instance uuid c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:36:54 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7136MB free_disk=25.487171173095703GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Acquiring lock "1a014eaf-7813-445b-b783-282ea30f034c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "1a014eaf-7813-445b-b783-282ea30f034c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5c163e-cf79-4466-8352-204fe72829a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:36:54 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.objects.instance [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lazy-loading 'flavor' on Instance uuid 1a014eaf-7813-445b-b783-282ea30f034c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[471d75ca-6787-4065-baec-2b6a224e6fbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf] added
Nov 08 21:36:54 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e778d473-194f-4468-a126-cd8723d34048]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dde073-86c0-4079-aaea-1753f7219c06]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.utils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLDoRSAX {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "1a014eaf-7813-445b-b783-282ea30f034c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLDoRSAX" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c85479-03d2-4ce7-b463-ced9d47f8346]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pLDoRSAX'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3867fdf-f545-4d82-a7bd-bd0863620152]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db174ae-a32f-4eab-8f32-6176ccc594b7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c0fb5b-f05b-41c1-937f-df5105e6eef8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lazy-loading 'flavor' on Instance uuid 0965adf7-0f82-4dfa-8d1d-8dafb805a132 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[590837b9-7f01-4ca3-8e8b-65b986b2923f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[39baf887-89f7-416b-bffe-ac90d95c5241]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:54 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:54 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:54 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:54 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a51f969-7a76-4485-abc0-b9093b17a3ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance a10c0a9d-5398-43db-8589-6e0763d7c5e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 35ca9fea-481a-42ac-8558-c5140e71de59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f0d20870-4544-428f-8963-4e358845514c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance c68ac7dc-3b4f-4d34-946d-86e8726c38af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1a014eaf-7813-445b-b783-282ea30f034c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1299c29d-4c41-43c5-ad63-7eae393065d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9bb5a995-4872-4671-91ab-ca0127d65181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d5c049a3-6f20-49d4-90df-e0222c2fdc8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 81c8325d-776c-4171-86eb-26f83b7dde00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.282s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93aed2b-2cd8-4ceb-b7ed-76992f90ec45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260]
Nov 08 21:36:54 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260] successful.
Nov 08 21:36:54 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:54 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[63647a8f-cfb3-4c91-81ea-5982511e2f4d]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.utils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] <== get_connector_properties: return (244ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating existing volume attachment record: fd31fb39-8a20-418b-b483-0486e702f143 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:54 user nova-compute[75993]: INFO nova.compute.manager [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Attaching volume c7e5b674-0bed-467b-8ada-382ee2164688 to /dev/vdb
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[689d5b17-9874-4433-91bc-06e75cd26f7e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62dde3b-ca00-450c-8e0b-6c8f7c9822e4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:54 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:54 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:36:54 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:54 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:54 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:36:54 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Acquiring lock "1a014eaf-7813-445b-b783-282ea30f034c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "1a014eaf-7813-445b-b783-282ea30f034c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:54 user nova-compute[75993]: INFO nova.compute.manager [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Attaching volume de7816ff-1d24-47fe-9ba4-254ac99a77c4 to /dev/vdb
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[562bf5ac-44e3-4eb9-aa21-51004327046b]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:36:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLDoRSAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.925s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOXuFyJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:55 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.utils [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f4dffd-57ec-49df-b59a-0236f28f9739]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[98011e0f-a049-4948-bf94-91bc6b48b2df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0434c45c-851d-4f5d-be9a-e65c1ac9a9ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3fced7-ccf0-460e-8691-9256e87f8838]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:55 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2c0f8e-a2d0-4d19-af80-34668aa543d4]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.515s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] <== connect_volume: return (1516ms) {'type': 'block', 'scsi_wwn': '26265306137666638', 'path': '/dev/sdd'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265306137666638', 'path': '/dev/sdd'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.utils [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updating existing volume attachment record: ba12ac7c-4ca4-40a9-9652-bcb17f40f5a7 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.211s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:36:55 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:36:55 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:55 user nova-compute[75993]: INFO nova.compute.manager [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Attaching volume 070a17f9-cc9c-4774-b207-2f8fee26f6ed to /dev/vdb
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.utils [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5427cad-dbf0-4d55-b5a0-d3310577b67a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:36:55 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lazy-loading 'flavor' on Instance uuid f0d20870-4544-428f-8963-4e358845514c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: INFO nova.virt.block_device [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Booting with volume 674908c5-638e-4e6e-ad65-81caac8d2be5 at /dev/vdb
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68d090e-28fd-4c19-884d-12e2f6f9f940]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:36:55 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:36:55 user nova-compute[75993]:   <source dev="/dev/sdd"/>
Nov 08 21:36:55 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:36:55 user nova-compute[75993]:   <serial>88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf</serial>
Nov 08 21:36:55 user nova-compute[75993]: </disk>
Nov 08 21:36:55 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f500742e-a2c5-4c30-a25a-6ae5e958285a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24] added
Nov 08 21:36:55 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf49102-e9b3-410c-87b9-36575a5a66f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a8dce6-31fd-47fe-96c4-77e85f7754bf]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc77361-0ba3-4f4e-ba46-b2f1f38cf7e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adb8762-e589-48ab-b625-0195988260a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32ae85b-c13b-4d36-9c70-652da16609f3]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOXuFyJH {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:56 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccfd53d-04f7-4346-937b-db1387a11723]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.utils [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Updating existing volume attachment record: 26e94b42-ab9f-4f18-85bf-619bbbbd203d {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOXuFyJH" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e1fb54-aa47-4e7e-ae09-bc206d022b24]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cOXuFyJH'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cc5530-3fc6-4a86-a0ad-5f946194cfb7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.utils [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead96bbf-56fd-4cb4-8967-3edf462bddd4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:56 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:56 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:36:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:56 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:56 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:36:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[320c3835-23ff-48e5-a980-aa33cb55e4ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a226c3-5b44-41b0-8ee2-6c53bbcc049e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.utils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c876a0e4-2901-443d-9fec-9df7909b2d94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d1c16d-242e-4900-9ebe-e69441950aeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[59714459-72c1-46e4-ac9a-49391b710539]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260]
Nov 08 21:36:56 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260] successful.
Nov 08 21:36:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dce18f3-d7c5-41fe-b17f-85a68bca28a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[586a15d7-7c5a-42d9-97b1-33e3b6821c2d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca60378-0e07-4d67-a785-478a33e892f1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:56 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3703c004-3dba-4bac-818c-9941b4a88178]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.utils [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Updating existing volume attachment record: 746e543c-8944-464a-aacd-ca19c0570ea8 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4385f3-1afd-4532-b92f-b2f96c040f57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: INFO nova.compute.manager [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Terminating instance
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4dc8d83-ef20-488a-b04d-27151a9e1163]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG nova.compute.manager [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0c02fa-8b98-449b-8228-0e1ff7efe2da]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:56 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:56 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:36:56 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:36:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:56 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:56 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:36:56 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:36:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.484s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:36:56 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89a52b5-e25a-4630-9847-9763a3962f3c]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.utils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating existing volume attachment record: fd3e5cd2-7f52-4c77-ade2-78798b83624b {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a42293a-ded3-4bb6-a684-ccad0e0dd029]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOXuFyJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] No VIF found with MAC fa:16:3e:94:f8:5d, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-3e7e9c79-bcf0-4c2e-a375-81c3facebab6 req-812e198c-e93e-4e80-bc51-199948fa1243 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Received event network-vif-unplugged-1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e7e9c79-bcf0-4c2e-a375-81c3facebab6 req-812e198c-e93e-4e80-bc51-199948fa1243 service nova] Acquiring lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e7e9c79-bcf0-4c2e-a375-81c3facebab6 req-812e198c-e93e-4e80-bc51-199948fa1243 service nova] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e7e9c79-bcf0-4c2e-a375-81c3facebab6 req-812e198c-e93e-4e80-bc51-199948fa1243 service nova] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-3e7e9c79-bcf0-4c2e-a375-81c3facebab6 req-812e198c-e93e-4e80-bc51-199948fa1243 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] No waiting events found dispatching network-vif-unplugged-1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:36:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-3e7e9c79-bcf0-4c2e-a375-81c3facebab6 req-812e198c-e93e-4e80-bc51-199948fa1243 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Received event network-vif-unplugged-1b82dac2-8540-49cd-88c9-1793a988574d for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:57 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Instance destroyed successfully.
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.objects.instance [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lazy-loading 'resources' on Instance uuid a10c0a9d-5398-43db-8589-6e0763d7c5e8 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:33:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1208221641',display_name='tempest-DeleteServersTestJSON-server-1208221641',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1208221641',id=3,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1951e152e794a0bb0d79af1c933c4a7',ramdisk_id='',reservation_id='r-e932l8vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1907290067',owner_user_name='tempest-DeleteServersTestJSON-1907290067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:34:16Z,user_data=None,user_id='a86000c1c779497ea6d1c260a633c4d3',uuid=a10c0a9d-5398-43db-8589-6e0763d7c5e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b82dac2-8540-49cd-88c9-1793a988574d", "address": "fa:16:3e:bb:b4:ce", "network": {"id": "9b94f568-ddd0-4c23-a4d8-eabfca7dab83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1551524033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1951e152e794a0bb0d79af1c933c4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b82dac2-85", "ovs_interfaceid": "1b82dac2-8540-49cd-88c9-1793a988574d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Converting VIF {"id": "1b82dac2-8540-49cd-88c9-1793a988574d", "address": "fa:16:3e:bb:b4:ce", "network": {"id": "9b94f568-ddd0-4c23-a4d8-eabfca7dab83", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1551524033-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1951e152e794a0bb0d79af1c933c4a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b82dac2-85", "ovs_interfaceid": "1b82dac2-8540-49cd-88c9-1793a988574d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b4:ce,bridge_name='br-int',has_traffic_filtering=True,id=1b82dac2-8540-49cd-88c9-1793a988574d,network=Network(9b94f568-ddd0-4c23-a4d8-eabfca7dab83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b82dac2-85') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_vif [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b4:ce,bridge_name='br-int',has_traffic_filtering=True,id=1b82dac2-8540-49cd-88c9-1793a988574d,network=Network(9b94f568-ddd0-4c23-a4d8-eabfca7dab83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b82dac2-85') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b82dac2-85, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac34543b-be3e-4a92-a1ef-ae64063a42b9) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:36:57 user nova-compute[75993]: INFO os_vif [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b4:ce,bridge_name='br-int',has_traffic_filtering=True,id=1b82dac2-8540-49cd-88c9-1793a988574d,network=Network(9b94f568-ddd0-4c23-a4d8-eabfca7dab83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b82dac2-85')
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qnJxlEfS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:36:57 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.531s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] <== connect_volume: return (1742ms) {'type': 'block', 'scsi_wwn': '26435316665356364', 'path': '/dev/sde'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435316665356364', 'path': '/dev/sde'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.223s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.objects.instance [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'flavor' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad583bc9-9c50-4572-89a8-8f6d474911be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:36:57 user nova-compute[75993]: No targets found.
Nov 08 21:36:57 user nova-compute[75993]: iSNS:
Nov 08 21:36:57 user nova-compute[75993]: No targets found.
Nov 08 21:36:57 user nova-compute[75993]: STATIC:
Nov 08 21:36:57 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:36:57 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:36:57 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:36:57 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4
Nov 08 21:36:57 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:36:57 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:36:57 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:36:57 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:36:57 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:36:57 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:36:57 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:36:57 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:36:57 user nova-compute[75993]: FIRMWARE:
Nov 08 21:36:57 user nova-compute[75993]: No targets found.
Nov 08 21:36:57 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:36:57 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:36:57 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:36:57 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:36:57 user nova-compute[75993]:   <source dev="/dev/sde"/>
Nov 08 21:36:57 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:36:57 user nova-compute[75993]:   <serial>e2ab3823-e622-43bb-8f66-0e85981a3e24</serial>
Nov 08 21:36:57 user nova-compute[75993]: </disk>
Nov 08 21:36:57 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cad1c3-2f5d-4e95-9194-a7f6a31d0acf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d38baa-2399-4529-a876-5a7095eaf51d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:57 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:57 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:36:57 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:36:57 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:36:57 user nova-compute[75993]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 (non-flash)
Nov 08 21:36:57 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:36:57 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:36:57 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f858c37be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[585cfd06-4855-405c-8756-4c698ccec9e5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d313646-c9d9-4bbf-9952-f322138199ee]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac2807f-e724-4d93-a3ae-3d289a38bf6b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d89bafc-726b-4ac8-a28b-d35c7783c50a]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0a1937-a096-4942-892e-b3ec43fa9cd2]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca451481-76a7-4d82-81c3-3995edc064d8]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4, portal: 172.16.0.220,3260]
Nov 08 21:36:57 user nova-compute[75993]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4, portal: 172.16.0.220,3260] successful.
Nov 08 21:36:57 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01959ef0-5a3f-40eb-9deb-fd064d5a16a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a0ce92-a0f6-4dd9-934c-99d727a9eb1f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] <== disconnect_volume: return (547ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:36:57 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Deleting instance files /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8_del
Nov 08 21:36:57 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Deletion of /opt/stack/data/nova/instances/a10c0a9d-5398-43db-8589-6e0763d7c5e8_del complete
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75993) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 08 21:36:57 user nova-compute[75993]: INFO nova.virt.libvirt.host [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] UEFI support detected
Nov 08 21:36:57 user nova-compute[75993]: INFO nova.compute.manager [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Took 1.54 seconds to destroy the instance on the hypervisor.
Nov 08 21:36:57 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:36:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] No VIF found with MAC fa:16:3e:9e:8c:e8, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:36:58 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:58 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Took 0.55 seconds to deallocate network for instance.
Nov 08 21:36:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-97ccfe7e-86e4-4156-8f0d-75d0d3bec685 req-b3fe282d-ef61-495e-b7ad-9d5f301047b6 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Received event network-vif-deleted-1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:58 user nova-compute[75993]: INFO nova.compute.manager [req-97ccfe7e-86e4-4156-8f0d-75d0d3bec685 req-b3fe282d-ef61-495e-b7ad-9d5f301047b6 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Neutron deleted interface 1b82dac2-8540-49cd-88c9-1793a988574d; detaching it from the instance and deleting it from the info cache
Nov 08 21:36:58 user nova-compute[75993]: DEBUG nova.network.neutron [req-97ccfe7e-86e4-4156-8f0d-75d0d3bec685 req-b3fe282d-ef61-495e-b7ad-9d5f301047b6 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:36:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-97ccfe7e-86e4-4156-8f0d-75d0d3bec685 req-b3fe282d-ef61-495e-b7ad-9d5f301047b6 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Detach interface failed, port_id=1b82dac2-8540-49cd-88c9-1793a988574d, reason: Instance a10c0a9d-5398-43db-8589-6e0763d7c5e8 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:36:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-0687eb53-66b2-4c50-8740-324375fdc599 req-ce88c4d2-1110-4950-a07f-0415388ed915 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Received event network-vif-plugged-1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:36:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0687eb53-66b2-4c50-8740-324375fdc599 req-ce88c4d2-1110-4950-a07f-0415388ed915 service nova] Acquiring lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:36:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0687eb53-66b2-4c50-8740-324375fdc599 req-ce88c4d2-1110-4950-a07f-0415388ed915 service nova] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:36:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0687eb53-66b2-4c50-8740-324375fdc599 req-ce88c4d2-1110-4950-a07f-0415388ed915 service nova] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:36:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-0687eb53-66b2-4c50-8740-324375fdc599 req-ce88c4d2-1110-4950-a07f-0415388ed915 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] No waiting events found dispatching network-vif-plugged-1b82dac2-8540-49cd-88c9-1793a988574d {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:36:58 user nova-compute[75993]: WARNING nova.compute.manager [req-0687eb53-66b2-4c50-8740-324375fdc599 req-ce88c4d2-1110-4950-a07f-0415388ed915 service nova] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Received unexpected event network-vif-plugged-1b82dac2-8540-49cd-88c9-1793a988574d for instance with vm_state active and task_state deleting.
Nov 08 21:37:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-6f324621-a76b-42a1-a03a-5a43367f9a81 req-f33cdada-be4b-4e10-8f70-34a246c3839e service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-changed-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:37:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-6f324621-a76b-42a1-a03a-5a43367f9a81 req-f33cdada-be4b-4e10-8f70-34a246c3839e service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Refreshing instance network info cache due to event network-changed-39262978-025e-4d08-a52b-4f361719f74a. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:37:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6f324621-a76b-42a1-a03a-5a43367f9a81 req-f33cdada-be4b-4e10-8f70-34a246c3839e service nova] Acquiring lock "refresh_cache-1299c29d-4c41-43c5-ad63-7eae393065d4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:37:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6f324621-a76b-42a1-a03a-5a43367f9a81 req-f33cdada-be4b-4e10-8f70-34a246c3839e service nova] Acquired lock "refresh_cache-1299c29d-4c41-43c5-ad63-7eae393065d4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:37:09 user nova-compute[75993]: DEBUG nova.network.neutron [req-6f324621-a76b-42a1-a03a-5a43367f9a81 req-f33cdada-be4b-4e10-8f70-34a246c3839e service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Refreshing network info cache for port 39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:37:10 user nova-compute[75993]: DEBUG nova.network.neutron [req-6f324621-a76b-42a1-a03a-5a43367f9a81 req-f33cdada-be4b-4e10-8f70-34a246c3839e service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Updated VIF entry in instance network info cache for port 39262978-025e-4d08-a52b-4f361719f74a. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:37:10 user nova-compute[75993]: DEBUG nova.network.neutron [req-6f324621-a76b-42a1-a03a-5a43367f9a81 req-f33cdada-be4b-4e10-8f70-34a246c3839e service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Updating instance_info_cache with network_info: [{"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:37:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6f324621-a76b-42a1-a03a-5a43367f9a81 req-f33cdada-be4b-4e10-8f70-34a246c3839e service nova] Releasing lock "refresh_cache-1299c29d-4c41-43c5-ad63-7eae393065d4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:37:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:17 user nova-compute[75993]: DEBUG nova.compute.manager [req-e0043c72-49f7-406f-b945-3c737aa33c5a req-fd994794-600e-4076-b239-15232c25bfd9 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received event network-changed-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:37:17 user nova-compute[75993]: DEBUG nova.compute.manager [req-e0043c72-49f7-406f-b945-3c737aa33c5a req-fd994794-600e-4076-b239-15232c25bfd9 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Refreshing instance network info cache due to event network-changed-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:37:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e0043c72-49f7-406f-b945-3c737aa33c5a req-fd994794-600e-4076-b239-15232c25bfd9 service nova] Acquiring lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:37:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e0043c72-49f7-406f-b945-3c737aa33c5a req-fd994794-600e-4076-b239-15232c25bfd9 service nova] Acquired lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:37:17 user nova-compute[75993]: DEBUG nova.network.neutron [req-e0043c72-49f7-406f-b945-3c737aa33c5a req-fd994794-600e-4076-b239-15232c25bfd9 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Refreshing network info cache for port 7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:37:18 user nova-compute[75993]: DEBUG nova.network.neutron [req-e0043c72-49f7-406f-b945-3c737aa33c5a req-fd994794-600e-4076-b239-15232c25bfd9 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Updated VIF entry in instance network info cache for port 7d3aebee-e3d9-4c37-be5c-0cc382f7ed59. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:37:18 user nova-compute[75993]: DEBUG nova.network.neutron [req-e0043c72-49f7-406f-b945-3c737aa33c5a req-fd994794-600e-4076-b239-15232c25bfd9 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Updating instance_info_cache with network_info: [{"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:37:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e0043c72-49f7-406f-b945-3c737aa33c5a req-fd994794-600e-4076-b239-15232c25bfd9 service nova] Releasing lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:37:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdzCjMHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:37:45 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:37:45 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:37:45 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e1069b-65da-4540-8038-e58d55381dd1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:37:45 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d7ea86-a180-412e-9dce-9e7ab6c564a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed] added
Nov 08 21:37:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1d2df6-4663-40c8-ba91-b821187aac08]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[308a79c7-6383-4fdd-bd52-5cda6e609cdc]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WdzCjMHF {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WdzCjMHF" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ffdbc4-4be9-4822-9ff0-4beeeab9719d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WdzCjMHF'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c19300d-18a6-4fe4-b756-76f7202d7772]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa25b8e9-0995-4bb9-ab76-5468b1175100]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:45 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:45 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:45 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:45 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4f7264-34ac-4e4b-8cf3-3bd7f7734c13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed, portal: 172.16.0.220,3260]
Nov 08 21:37:45 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed, portal: 172.16.0.220,3260] successful.
Nov 08 21:37:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[833630ad-d017-4b2b-9244-e2e58a77c6a1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[83beaff3-b5df-4226-8179-9cb581e47efe]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:45 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:45 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:45 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:45 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:45 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:45 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4961fdc-697f-42aa-b0c8-19445a0f6113]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkVzEnJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:37:46 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CyLnAcbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:37:46 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee3688f9-0a60-46a9-8c7d-c4a2f6544e3c tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 81.788s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-70d0d738-6ce4-4e9f-b419-847fa28cdf23 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 82.066s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:37:46 user nova-compute[75993]: INFO nova.virt.block_device [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Booting with volume a393c62a-ed47-4239-9da3-88971b8318d2 at /dev/vdc
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdzCjMHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26465626164333237', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465626164333237', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.436s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:37:46 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:37:46 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lazy-loading 'flavor' on Instance uuid 0965adf7-0f82-4dfa-8d1d-8dafb805a132 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0affeea1-b438-4e99-a3d8-e9c9f27ca262]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:37:46 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:37:46 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:37:46 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 21:37:46 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:37:46 user nova-compute[75993]:   <serial>070a17f9-cc9c-4774-b207-2f8fee26f6ed</serial>
Nov 08 21:37:46 user nova-compute[75993]: </disk>
Nov 08 21:37:46 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ae3fa5-d8db-4baa-8f66-86ed107f1664]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688] added
Nov 08 21:37:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a89dcd-1b6e-4081-bdb7-325a7efc5477]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d704f49f-ecb4-45e9-943b-a43fdf48b309]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkVzEnJA {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lkVzEnJA" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aae5ccc-a8bc-4e09-8665-f633a761b395]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lkVzEnJA'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e61f7a-579c-4bc8-b672-3f905359679e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a5b757-acdb-4ef5-9269-aab05e3507fa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1049cb-0f62-451d-9dc9-0cb15bf8be64]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688, portal: 172.16.0.220,3260]
Nov 08 21:37:46 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688, portal: 172.16.0.220,3260] successful.
Nov 08 21:37:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[505ad2ab-4889-4804-bbf4-3758a741eade]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[177bd1f9-ae5c-4499-bf67-6ffd0d7382db]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:37:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:46 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:37:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f3b1dc-c5e2-4973-9745-6632cdbf5448]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkVzEnJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] No VIF found with MAC fa:16:3e:7d:30:7b, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG os_brick.utils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[309ef31d-41ab-45bc-aeb9-95630d0d171f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8018cb46-9591-472f-b50b-963b90e05ceb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "9bb5a995-4872-4671-91ab-ca0127d65181" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7340cdd9-fea7-4575-aa9d-3169b4640224]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2267d3-011e-469b-830d-170396d5a1ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG nova.objects.instance [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lazy-loading 'flavor' on Instance uuid 9bb5a995-4872-4671-91ab-ca0127d65181 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:37:47 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecb2e49-5fa9-4e1c-b144-bdb2da120d01]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG os_brick.utils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating existing volume attachment record: b5ff47c0-5f38-4e1c-a79e-2ebdfdb478b8 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.259s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ed4486ae-a6e9-45f0-a328-4a8f50c83ca4 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 51.711s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:37:47 user nova-compute[75993]: INFO nova.compute.manager [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] [instance: a10c0a9d-5398-43db-8589-6e0763d7c5e8] Took 49.24 seconds to detach 1 volumes for instance.
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:47 user nova-compute[75993]: INFO nova.compute.manager [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Rebuilding instance
Nov 08 21:37:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] <== connect_volume: return (1772ms) {'type': 'block', 'scsi_wwn': '23465393833336430', 'path': '/dev/sdf'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465393833336430', 'path': '/dev/sdf'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.702s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:37:48 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:37:48 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "9bb5a995-4872-4671-91ab-ca0127d65181" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:48 user nova-compute[75993]: INFO nova.compute.manager [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Attaching volume bcd93720-6537-47ac-8699-c725dce4affc to /dev/vdb
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fc071a-7950-4aa0-af5c-9a4e70e69996]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:37:48 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.objects.instance [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lazy-loading 'flavor' on Instance uuid c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[953824ac-98a5-42e0-9e8d-6a4d49df0fdd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4] added
Nov 08 21:37:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "f0d20870-4544-428f-8963-4e358845514c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:37:48 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:37:48 user nova-compute[75993]:   <source dev="/dev/sdf"/>
Nov 08 21:37:48 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:37:48 user nova-compute[75993]:   <serial>c7e5b674-0bed-467b-8ada-382ee2164688</serial>
Nov 08 21:37:48 user nova-compute[75993]: </disk>
Nov 08 21:37:48 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d3856e-d304-47b0-af92-f405ebd119d2]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.utils [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae790db-f6f6-4e55-b9be-c35501fdc574]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4445c6b1-94b8-4234-83c2-059b406c116e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CyLnAcbH {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CyLnAcbH" returned: 0 in 0.036s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fe246a-c248-4b3b-963d-a0d8dd19eb8d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CyLnAcbH'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.utils [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.052s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8901ab-676d-41fe-ab22-35432c4da0fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29af200-2e72-4181-a1fd-a54d6b4efbc7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bc892a6e-75c8-466d-98eb-d126f27b67d2 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bc892a6e-75c8-466d-98eb-d126f27b67d2 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-bc892a6e-75c8-466d-98eb-d126f27b67d2 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0a2129-9a89-4bfe-ad92-548ebd3cbd08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.046s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[29478a80-ccee-4194-86d3-19d9b1fcdb84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a89fb1c-4cba-4086-b1c3-c4f7cc62016d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5aabbd-4c42-4cfa-a2b8-4a0f2d2148e2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f24a7d-e87e-4ac3-97bd-dc03d2689a61]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:37:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:37:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-bc892a6e-75c8-466d-98eb-d126f27b67d2 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75993) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.objects.instance [None req-bc892a6e-75c8-466d-98eb-d126f27b67d2 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'flavor' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:37:48 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca806fc-dc2a-491c-8ec8-d0d56a1d7825]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc511388-ba95-43b3-bc2c-ff9ae1a9f74d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.utils [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] <== get_connector_properties: return (250ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e7976e-db54-47c5-b110-1c8faa9598b3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa85de50-4be2-4d7e-8bab-8faef1652a65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.742s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4, portal: 172.16.0.220,3260]
Nov 08 21:37:48 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4, portal: 172.16.0.220,3260] successful.
Nov 08 21:37:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:37:48 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef5a5ee-a9bd-4225-a817-9a96dc4dadbf]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.utils [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] <== get_connector_properties: return (307ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Updating existing volume attachment record: d063163e-a3cd-4e6c-9d45-a877fa33fd65 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedd4347-1098-44e0-9e63-ad2dacdd7fe8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e929d00-24e9-488b-9ddd-5c73990ac8ee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:37:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:37:48 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:37:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.570s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] No BDM found with device name hda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] No VIF found with MAC fa:16:3e:61:e1:be, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b76099c-f647-4775-8f13-9bd6085f6944]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CyLnAcbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:37:48 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Deleted allocations for instance a10c0a9d-5398-43db-8589-6e0763d7c5e8
Nov 08 21:37:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:48 user nova-compute[75993]: INFO nova.compute.manager [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] Swapping volume 88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf for bf0a422a-57f7-4f07-a32f-6d6a4845ba7b
Nov 08 21:37:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updating instance_info_cache with network_info: [{"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-1a5b00ae-b431-43d0-9a21-22d8d2b10f14 req-bfc211e7-56c8-4cff-8e85-328f4709abb4 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-unplugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a5b00ae-b431-43d0-9a21-22d8d2b10f14 req-bfc211e7-56c8-4cff-8e85-328f4709abb4 service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a5b00ae-b431-43d0-9a21-22d8d2b10f14 req-bfc211e7-56c8-4cff-8e85-328f4709abb4 service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a5b00ae-b431-43d0-9a21-22d8d2b10f14 req-bfc211e7-56c8-4cff-8e85-328f4709abb4 service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-1a5b00ae-b431-43d0-9a21-22d8d2b10f14 req-bfc211e7-56c8-4cff-8e85-328f4709abb4 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-unplugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:37:48 user nova-compute[75993]: WARNING nova.compute.manager [req-1a5b00ae-b431-43d0-9a21-22d8d2b10f14 req-bfc211e7-56c8-4cff-8e85-328f4709abb4 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received unexpected event network-vif-unplugged-39262978-025e-4d08-a52b-4f361719f74a for instance with vm_state active and task_state rebuilding.
Nov 08 21:37:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-2901f5d4-74aa-40e7-a58f-b21d771364d4 req-588ef5a5-1937-4175-9771-12471926e596 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-unplugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2901f5d4-74aa-40e7-a58f-b21d771364d4 req-588ef5a5-1937-4175-9771-12471926e596 service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2901f5d4-74aa-40e7-a58f-b21d771364d4 req-588ef5a5-1937-4175-9771-12471926e596 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2901f5d4-74aa-40e7-a58f-b21d771364d4 req-588ef5a5-1937-4175-9771-12471926e596 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-2901f5d4-74aa-40e7-a58f-b21d771364d4 req-588ef5a5-1937-4175-9771-12471926e596 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-unplugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:37:48 user nova-compute[75993]: WARNING nova.compute.manager [req-2901f5d4-74aa-40e7-a58f-b21d771364d4 req-588ef5a5-1937-4175-9771-12471926e596 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received unexpected event network-vif-unplugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with vm_state active and task_state powering-off.
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-feff3296-4d92-4df7-8778-bcf35655ce56 tempest-DeleteServersTestJSON-1907290067 tempest-DeleteServersTestJSON-1907290067-project-member] Lock "a10c0a9d-5398-43db-8589-6e0763d7c5e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 52.739s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:49 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Instance destroyed successfully.
Nov 08 21:37:49 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Instance destroyed successfully.
Nov 08 21:37:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1446269913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1121926887',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtrasof5VVa4N8t9Ec62wXGBSSsbRBbjGULzKVdN0bVvyZ8swMlrLds8d3lYzELTg6JrOJuucCuAAXEYpOoJNoBGe6KIU1HN5gatSV5zcSocuW2xYg9jQETQ50lGSxPmQ==',key_name='tempest-keypair-601691060',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='586af433a3ee4cc387be213c0d0fca05',ramdisk_id='',reservation_id='r-sk248x4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-553177767',owner_user_name='tempest-ServerActionsV293TestJSON-553177767-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:37:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c4d6c12e8b64175af3777dbf15ee11e',uuid=1299c29d-4c41-43c5-ad63-7eae393065d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converting VIF {"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_vif [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39262978-02, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:37:49 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance destroyed successfully.
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-bc892a6e-75c8-466d-98eb-d126f27b67d2 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=834fc261-fad1-4c8e-9c7f-c0424fc72111) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:49 user nova-compute[75993]: INFO os_vif [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02')
Nov 08 21:37:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQxklKTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:37:49 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bc892a6e-75c8-466d-98eb-d126f27b67d2 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.208s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.624s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] <== connect_volume: return (3327ms) {'type': 'block', 'scsi_wwn': '26665623332666131', 'path': '/dev/sdg'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665623332666131', 'path': '/dev/sdg'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.230s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG nova.objects.instance [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lazy-loading 'flavor' on Instance uuid 1a014eaf-7813-445b-b783-282ea30f034c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[882f13cd-f6b3-48a1-afd5-9d67124634bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:37:49 user nova-compute[75993]: No targets found.
Nov 08 21:37:49 user nova-compute[75993]: iSNS:
Nov 08 21:37:49 user nova-compute[75993]: No targets found.
Nov 08 21:37:49 user nova-compute[75993]: STATIC:
Nov 08 21:37:49 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed
Nov 08 21:37:49 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:37:49 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:37:49 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:37:49 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:37:49 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:37:49 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4
Nov 08 21:37:49 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:37:49 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:37:49 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:37:49 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:37:49 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:37:49 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:37:49 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:37:49 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:37:49 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688
Nov 08 21:37:49 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:37:49 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:37:49 user nova-compute[75993]: FIRMWARE:
Nov 08 21:37:49 user nova-compute[75993]: No targets found.
Nov 08 21:37:49 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:37:49 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:37:49 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] attach device xml: <disk type="block" device="disk">
Nov 08 21:37:49 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:37:49 user nova-compute[75993]:   <source dev="/dev/sdg"/>
Nov 08 21:37:49 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:37:49 user nova-compute[75993]:   <serial>de7816ff-1d24-47fe-9ba4-254ac99a77c4</serial>
Nov 08 21:37:49 user nova-compute[75993]: </disk>
Nov 08 21:37:49 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e5fbfe-8adb-46db-94a3-1981994ad7f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff58f02-769b-417a-bb1e-8b6bb482ca94]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:49 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:49 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:49 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:49 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:37:49 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:37:49 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:37:49 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:37:49 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:37:49 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:37:49 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:37:49 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:37:49 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f856847fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[056f203b-36cb-4e6e-a7b5-fe5aa3153201]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[65511b4c-06e5-4ecb-bb38-03d9ddbc1b04]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[77608edf-7fc9-4f13-89a2-b6ccda40a4d8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[36778ecf-0d7a-43a5-8159-5e6656bd45af]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be34bea-2298-45b6-8230-130fb06c550f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff3bb05-b9d2-4a39-8ca3-5db7fadfd455]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260]
Nov 08 21:37:50 user nova-compute[75993]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260] successful.
Nov 08 21:37:50 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ab4e0f-721d-412e-a838-2fb852650c2b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] <== disconnect_volume: return (648ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:37:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Deleting instance files /opt/stack/data/nova/instances/1299c29d-4c41-43c5-ad63-7eae393065d4_del
Nov 08 21:37:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Deletion of /opt/stack/data/nova/instances/1299c29d-4c41-43c5-ad63-7eae393065d4_del complete
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] No VIF found with MAC fa:16:3e:3a:56:bd, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:37:50 user nova-compute[75993]: WARNING nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received unexpected event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a for instance with vm_state active and task_state rebuilding.
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:37:50 user nova-compute[75993]: WARNING nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received unexpected event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a for instance with vm_state active and task_state rebuilding.
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:37:50 user nova-compute[75993]: WARNING nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received unexpected event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a for instance with vm_state active and task_state rebuilding.
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-unplugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-unplugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:37:50 user nova-compute[75993]: WARNING nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received unexpected event network-vif-unplugged-39262978-025e-4d08-a52b-4f361719f74a for instance with vm_state active and task_state rebuilding.
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:37:50 user nova-compute[75993]: WARNING nova.compute.manager [req-0297257f-fa36-4344-800e-c322e662afad req-e998ae22-b9ef-40ad-9e21-4d60e8dd96fc service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received unexpected event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a for instance with vm_state active and task_state rebuilding.
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-a0e49a36-28f1-4c59-a36c-811059809ada req-d983cb5d-7800-4a72-ace8-5c69a1d89922 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a0e49a36-28f1-4c59-a36c-811059809ada req-d983cb5d-7800-4a72-ace8-5c69a1d89922 service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a0e49a36-28f1-4c59-a36c-811059809ada req-d983cb5d-7800-4a72-ace8-5c69a1d89922 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a0e49a36-28f1-4c59-a36c-811059809ada req-d983cb5d-7800-4a72-ace8-5c69a1d89922 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-a0e49a36-28f1-4c59-a36c-811059809ada req-d983cb5d-7800-4a72-ace8-5c69a1d89922 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:37:51 user nova-compute[75993]: WARNING nova.compute.manager [req-a0e49a36-28f1-4c59-a36c-811059809ada req-d983cb5d-7800-4a72-ace8-5c69a1d89922 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received unexpected event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with vm_state stopped and task_state None.
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:52 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Error from libvirt while getting description of instance-00000009: [Error Code 42] Domain not found: no domain with matching uuid '1299c29d-4c41-43c5-ad63-7eae393065d4' (instance-00000009): libvirt.libvirtError: Domain not found: no domain with matching uuid '1299c29d-4c41-43c5-ad63-7eae393065d4' (instance-00000009)
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:37:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:37:53 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:37:53 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:37:53 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7816MB free_disk=25.496925354003906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:37:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:37:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 35ca9fea-481a-42ac-8558-c5140e71de59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f0d20870-4544-428f-8963-4e358845514c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance c68ac7dc-3b4f-4d34-946d-86e8726c38af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 81c8325d-776c-4171-86eb-26f83b7dde00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1299c29d-4c41-43c5-ad63-7eae393065d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d5c049a3-6f20-49d4-90df-e0222c2fdc8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9bb5a995-4872-4671-91ab-ca0127d65181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1a014eaf-7813-445b-b783-282ea30f034c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:37:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:37:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:37:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:37:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:37:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:37:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:37:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:37:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:37:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:37:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:37:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 21:37:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:37:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:37:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 21:38:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:38:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:38:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMJKdYlP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:15 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:15 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:15 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d19e001-0dcc-45fd-a188-e78f73d6dcae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:38:15 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[426398cf-d4f4-455c-8893-273bbfff4f6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc] added
Nov 08 21:38:15 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbe6714-9d76-4e47-84a4-952fcf0c5c44]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4da6dcce-7a4f-4d25-af61-e8d53a180f8d tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 80.596s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5caba6f-ce6b-4600-b0a0-534977331c9a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMJKdYlP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iMJKdYlP" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1eb3db-5f7a-4f07-848a-d5942d452ea3]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iMJKdYlP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[941f7154-08cd-41a3-a916-d543ecc40b57]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e9e7b3-facd-4157-baec-3005a750239a]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0515fb-a7df-4dda-a0d7-56b4bd323889]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc, portal: 172.16.0.220,3260]
Nov 08 21:38:15 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:15 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0cfad5-708f-4fb1-9373-9db63a61f594]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca29944-94fc-4143-bd98-8175f675fb24]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:15 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:15 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:15 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4ddbc5f-407c-427b-9510-9db79f3ee0cb tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "1a014eaf-7813-445b-b783-282ea30f034c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 80.792s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0c385d-fa6f-4986-bf4a-ecb25420e755]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:38:15 user nova-compute[75993]: INFO nova.virt.block_device [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Booting with volume a51c11f4-ca9d-41f5-825c-baa074b93b47 at /dev/vdc
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:15 user nova-compute[75993]: INFO nova.compute.manager [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Detaching volume 070a17f9-cc9c-4774-b207-2f8fee26f6ed
Nov 08 21:38:16 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 1299c29d-4c41-43c5-ad63-7eae393065d4 could not be found.
Nov 08 21:38:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQxklKTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:16 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:16 user nova-compute[75993]: INFO nova.virt.block_device [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Attempting to driver detach volume 070a17f9-cc9c-4774-b207-2f8fee26f6ed from mountpoint /dev/vdb
Nov 08 21:38:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Attempting to detach device vdb from instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:38:16 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:16 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 21:38:16 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:38:16 user nova-compute[75993]:   <serial>070a17f9-cc9c-4774-b207-2f8fee26f6ed</serial>
Nov 08 21:38:16 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:38:16 user nova-compute[75993]: </disk>
Nov 08 21:38:16 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:38:16 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Successfully detached device vdb from instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 from the persistent domain config.
Nov 08 21:38:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:38:16 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:16 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 21:38:16 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:38:16 user nova-compute[75993]:   <serial>070a17f9-cc9c-4774-b207-2f8fee26f6ed</serial>
Nov 08 21:38:16 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:38:16 user nova-compute[75993]: </disk>
Nov 08 21:38:16 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.utils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a1e76-c711-4e57-9f8b-7531f5caa536]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d172bd4-2bd0-4585-8cf6-547e7785d2ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d4344a-f8fb-41f4-9401-a96714b16315]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fa5764-5582-4d26-b6f6-681b997091b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:38:16 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7aa508-63b4-43be-a4bb-2b0e1deb05aa]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.utils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating existing volume attachment record: fb9fe7b4-032c-4fbc-b9ed-1c234a7fd85e {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMJKdYlP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23439333732636365', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439333732636365', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.588s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG nova.objects.instance [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lazy-loading 'flavor' on Instance uuid 9bb5a995-4872-4671-91ab-ca0127d65181 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[def693d2-9086-4ce9-9a63-cb93b3033e52]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:38:16 user nova-compute[75993]: No targets found.
Nov 08 21:38:16 user nova-compute[75993]: iSNS:
Nov 08 21:38:16 user nova-compute[75993]: No targets found.
Nov 08 21:38:16 user nova-compute[75993]: STATIC:
Nov 08 21:38:16 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed
Nov 08 21:38:16 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:16 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:16 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:38:16 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:16 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:16 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4
Nov 08 21:38:16 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:16 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:16 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:38:16 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:16 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:16 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc
Nov 08 21:38:16 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:16 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:16 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688
Nov 08 21:38:16 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:16 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:16 user nova-compute[75993]: FIRMWARE:
Nov 08 21:38:16 user nova-compute[75993]: No targets found.
Nov 08 21:38:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:38:16 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:38:16 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f233f0-5ec0-42dd-b959-dcb88c9fee82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:38:16 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:16 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:38:16 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:38:16 user nova-compute[75993]:   <serial>bcd93720-6537-47ac-8699-c725dce4affc</serial>
Nov 08 21:38:16 user nova-compute[75993]: </disk>
Nov 08 21:38:16 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5946a0-3c8f-44f8-ac56-42f57071aafd]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:16 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:16 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:16 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:16 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:16 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:16 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:16 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:16 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:16 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:16 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f85684f77f0>, {}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Disconnecting from: [] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] <== disconnect_volume: return (671ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:38:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:38:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:38:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] No VIF found with MAC fa:16:3e:f3:07:9b, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:38:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Preparing to wait for external event volume-reimaged-d4af4d21-6fd7-4f91-9cf3-d8e66e91403e {{(pid=75993) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 08 21:38:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57a8fd82-f96d-4867-8be7-f7d4db954dda tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.932s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:38:20 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Creating image(s)
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Ensure instance console log exists: /opt/stack/data/nova/instances/f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Start _get_guest_xml network_info=[{"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf50bddc-3f74-4d9e-9003-e8075806a131", "address": "fa:16:3e:5e:15:67", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf50bddc-3f", "ovs_interfaceid": "bf50bddc-3f74-4d9e-9003-e8075806a131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'c53aa686-236f-4688-8e46-c92d86d47479', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMGIFEZm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1', 'attached_at': '', 'detached_at': '', 'volume_id': '878fed90-8eac-4987-9bd7-bf3aa880998d', 'serial': '878fed90-8eac-4987-9bd7-bf3aa880998d'}, 'volume_type': None}, {'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': 1, 'attachment_id': 'fd31fb39-8a20-418b-b483-0486e702f143', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EciQlxYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1', 'attached_at': '', 'detached_at': '', 'volume_id': 'abd64a7d-2eb8-498d-996d-53642e92234a', 'serial': 'abd64a7d-2eb8-498d-996d-53642e92234a'}, 'volume_type': None}, {'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': 2, 'attachment_id': 'b5ff47c0-5f38-4e1c-a79e-2ebdfdb478b8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJkqTxDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a393c62a-ed47-4239-9da3-88971b8318d2', 'serial': 'a393c62a-ed47-4239-9da3-88971b8318d2'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:38:20 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:38:20 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMGIFEZm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:20 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:20 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:20 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cc15f1-d55a-4387-acdf-4de74bdef760]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:38:20 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[045c20c5-1157-4040-809e-a6eafb5a0f0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d] added
Nov 08 21:38:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafd3105-aec2-4b42-964f-30a4503104fc]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[661f7890-1f5a-4a9d-be53-abc5037173c8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OMGIFEZm {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OMGIFEZm" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4d1a1e-6438-46de-a1b3-55f0943386fb]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OMGIFEZm'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba16a4f-e776-43f8-82cc-63e7838f6b17]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e058828-fa17-4482-8f56-b0b8e46e36b5]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:20 user nova-compute[75993]: INFO nova.compute.manager [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Detaching volume c7e5b674-0bed-467b-8ada-382ee2164688
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c5e09d-6b4b-4934-8a13-abe3b0cdbd7b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d, portal: 172.16.0.220,3260]
Nov 08 21:38:20 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1943bfb8-dc65-42e5-86fc-da0a8572f5e6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f9eb78-d827-44ef-8c9d-b3816573dee6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:20 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[635463cb-e5e0-4aef-8f12-e956f4ab7f91]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMGIFEZm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-00a424fe-89a0-49d9-b202-a0eddf78279e tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] volume_snapshot_create: create_info: {'snapshot_id': '798abb0b-fb99-445f-b097-78d9c0fffbb5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75993) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-00a424fe-89a0-49d9-b202-a0eddf78279e tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] snap xml: <domainsnapshot>
Nov 08 21:38:20 user nova-compute[75993]:   <disks>
Nov 08 21:38:20 user nova-compute[75993]:     <disk name="/dev/sdg" snapshot="external" type="file">
Nov 08 21:38:20 user nova-compute[75993]:       <source file="/dev/new_file"/>
Nov 08 21:38:20 user nova-compute[75993]:     </disk>
Nov 08 21:38:20 user nova-compute[75993]:     <disk name="vda" snapshot="no"/>
Nov 08 21:38:20 user nova-compute[75993]:   </disks>
Nov 08 21:38:20 user nova-compute[75993]: </domainsnapshot>
Nov 08 21:38:20 user nova-compute[75993]:  {{(pid=75993) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.objects.instance [None req-00a424fe-89a0-49d9-b202-a0eddf78279e tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] Lazy-loading 'system_metadata' on Instance uuid 1a014eaf-7813-445b-b783-282ea30f034c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:20 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-00a424fe-89a0-49d9-b202-a0eddf78279e tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [None req-00a424fe-89a0-49d9-b202-a0eddf78279e tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Traceback (most recent call last):
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     rv = execute(f, *args, **kwargs)
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     six.reraise(c, e, tb)
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     raise value
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     rv = meth(*args, **kwargs)
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c] 
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [None req-00a424fe-89a0-49d9-b202-a0eddf78279e tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Traceback (most recent call last):
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     self._volume_snapshot_create(context, instance, guest,
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     rv = execute(f, *args, **kwargs)
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     six.reraise(c, e, tb)
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     raise value
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     rv = meth(*args, **kwargs)
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c] 
Nov 08 21:38:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1e7bc76f-c825-4e4e-8d94-3721a09c0e9a tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] volume_snapshot_delete: delete_info: {'volume_id': 'de7816ff-1d24-47fe-9ba4-254ac99a77c4'} {{(pid=75993) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [None req-1e7bc76f-c825-4e4e-8d94-3721a09c0e9a tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Traceback (most recent call last):
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c]     if delete_info['type'] != 'qcow2':
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c] KeyError: 'type'
Nov 08 21:38:20 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [instance: 1a014eaf-7813-445b-b783-282ea30f034c] 
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [None req-00a424fe-89a0-49d9-b202-a0eddf78279e tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 798abb0b-fb99-445f-b097-78d9c0fffbb5 could not be found.
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     raise value
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver 
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver 
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 798abb0b-fb99-445f-b097-78d9c0fffbb5 could not be found. (HTTP 404) (Request-ID: req-8cc026a4-17de-477a-a634-eca28d794a36)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver 
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver 
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 798abb0b-fb99-445f-b097-78d9c0fffbb5 could not be found.
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver 
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver [None req-1e7bc76f-c825-4e4e-8d94-3721a09c0e9a tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver 
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver 
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-ab400337-6406-4058-abdb-5915e31a6ba0)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver 
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver 
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 08 21:38:21 user nova-compute[75993]: ERROR nova.virt.libvirt.driver 
Nov 08 21:38:21 user nova-compute[75993]: INFO nova.virt.block_device [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Attempting to driver detach volume c7e5b674-0bed-467b-8ada-382ee2164688 from mountpoint /dev/vdb
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server [None req-00a424fe-89a0-49d9-b202-a0eddf78279e tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise value
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server 
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server [None req-1e7bc76f-c825-4e4e-8d94-3721a09c0e9a tempest-VolumesAssistedSnapshotsTest-1165621062 tempest-VolumesAssistedSnapshotsTest-1165621062-project] Exception during message handling: KeyError: 'type'
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 08 21:38:21 user nova-compute[75993]: ERROR oslo_messaging.rpc.server 
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Attempting to detach device vdb from instance c68ac7dc-3b4f-4d34-946d-86e8726c38af from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:38:21 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:21 user nova-compute[75993]:   <source dev="/dev/sdf"/>
Nov 08 21:38:21 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:38:21 user nova-compute[75993]:   <serial>c7e5b674-0bed-467b-8ada-382ee2164688</serial>
Nov 08 21:38:21 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 21:38:21 user nova-compute[75993]: </disk>
Nov 08 21:38:21 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:38:21 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Successfully detached device vdb from instance c68ac7dc-3b4f-4d34-946d-86e8726c38af from the persistent domain config.
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c68ac7dc-3b4f-4d34-946d-86e8726c38af from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:38:21 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:21 user nova-compute[75993]:   <source dev="/dev/sdf"/>
Nov 08 21:38:21 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:38:21 user nova-compute[75993]:   <serial>c7e5b674-0bed-467b-8ada-382ee2164688</serial>
Nov 08 21:38:21 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 21:38:21 user nova-compute[75993]: </disk>
Nov 08 21:38:21 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Acquiring lock "1a014eaf-7813-445b-b783-282ea30f034c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "1a014eaf-7813-445b-b783-282ea30f034c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:21 user nova-compute[75993]: INFO nova.compute.manager [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Detaching volume de7816ff-1d24-47fe-9ba4-254ac99a77c4
Nov 08 21:38:21 user nova-compute[75993]: INFO nova.virt.block_device [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Attempting to driver detach volume de7816ff-1d24-47fe-9ba4-254ac99a77c4 from mountpoint /dev/vdb
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Attempting to detach device vdb from instance 1a014eaf-7813-445b-b783-282ea30f034c from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 21:38:21 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:21 user nova-compute[75993]:   <source dev="/dev/sdg"/>
Nov 08 21:38:21 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:38:21 user nova-compute[75993]:   <serial>de7816ff-1d24-47fe-9ba4-254ac99a77c4</serial>
Nov 08 21:38:21 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:38:21 user nova-compute[75993]: </disk>
Nov 08 21:38:21 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:38:21 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Successfully detached device vdb from instance 1a014eaf-7813-445b-b783-282ea30f034c from the persistent domain config.
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a014eaf-7813-445b-b783-282ea30f034c from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] detach device xml: <disk type="block" device="disk">
Nov 08 21:38:21 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:21 user nova-compute[75993]:   <source dev="/dev/sdg"/>
Nov 08 21:38:21 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:38:21 user nova-compute[75993]:   <serial>de7816ff-1d24-47fe-9ba4-254ac99a77c4</serial>
Nov 08 21:38:21 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:38:21 user nova-compute[75993]: </disk>
Nov 08 21:38:21 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26461373065313935', 'path': '/dev/sdh'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461373065313935', 'path': '/dev/sdh'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EciQlxYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:21 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:21 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:21 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e876d07-0ebd-4980-bc90-c6d821ea37e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:38:21 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53db54b-295b-468c-b8ea-23ba3e310b12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a] added
Nov 08 21:38:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4662a61-6347-45c4-8128-0c4804b94e50]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc8039d-f947-4d0f-b5bb-a0dd8a550b07]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EciQlxYt {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EciQlxYt" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[011c03e7-f67c-44ba-90ab-44103610b9ad]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EciQlxYt'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[247f9393-06a3-44f6-9e31-4b7ab13cde77]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[906306d0-889a-450c-8e99-af881a74f7be]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[886a2379-720e-4431-8d5a-e5ff93ae0f60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a, portal: 172.16.0.220,3260]
Nov 08 21:38:21 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5d89f8-38d5-4b70-8d4d-c712c86e64b9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d541da26-6abe-48e0-8dc3-2c9df9032291]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:21 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a014eaf-7813-445b-b783-282ea30f034c {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[06188f44-265a-4103-9c25-71be682d4a20]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:38:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EciQlxYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:38:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "9bb5a995-4872-4671-91ab-ca0127d65181" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:22 user nova-compute[75993]: INFO nova.compute.manager [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Detaching volume bcd93720-6537-47ac-8699-c725dce4affc
Nov 08 21:38:22 user nova-compute[75993]: INFO nova.virt.block_device [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Attempting to driver detach volume bcd93720-6537-47ac-8699-c725dce4affc from mountpoint /dev/vdb
Nov 08 21:38:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Attempting to detach device vdb from instance 9bb5a995-4872-4671-91ab-ca0127d65181 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:38:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:38:22 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:22 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:38:22 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:38:22 user nova-compute[75993]:   <serial>bcd93720-6537-47ac-8699-c725dce4affc</serial>
Nov 08 21:38:22 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:38:22 user nova-compute[75993]: </disk>
Nov 08 21:38:22 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:38:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Successfully detached device vdb from instance 9bb5a995-4872-4671-91ab-ca0127d65181 from the persistent domain config.
Nov 08 21:38:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bb5a995-4872-4671-91ab-ca0127d65181 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:38:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:38:22 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:22 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:38:22 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:38:22 user nova-compute[75993]:   <serial>bcd93720-6537-47ac-8699-c725dce4affc</serial>
Nov 08 21:38:22 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:38:22 user nova-compute[75993]: </disk>
Nov 08 21:38:22 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23466313830623130', 'path': '/dev/sdi'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466313830623130', 'path': '/dev/sdi'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJkqTxDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:23 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:23 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:23 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a20553-14a9-4b42-95ac-59249f72600d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:38:23 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ccf5d4-7b5b-4884-966d-5b3c47f089cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2] added
Nov 08 21:38:23 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bb5a995-4872-4671-91ab-ca0127d65181 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[18682c70-ad30-4dfd-9455-cd728a4bb7f8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f9f06a-61cb-408b-8832-7d7dda5f22e5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJkqTxDY {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bJkqTxDY" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71336df-4d80-43a7-af81-3e74c388a938]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bJkqTxDY'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaee8d3-2219-4bc5-a155-e2e15488a114]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f60d90-9cd0-4caa-9d11-a7a6934a32e2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:23 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:23 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bc0cfd-67fe-472e-ae61-98a013a50b15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2, portal: 172.16.0.220,3260]
Nov 08 21:38:23 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:23 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98e91bf-e04c-4abd-b6ae-55689bf68c5f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4405475-ee89-4ddf-a7b1-b1451e7df57a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:23 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:23 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:23 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bcc1b7-8efa-429d-b647-cdd81d352be3]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:38:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJkqTxDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23663323063623137', 'path': '/dev/sdj'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663323063623137', 'path': '/dev/sdj'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:a0:da,bridge_name='br-int',has_traffic_filtering=True,id=8061d712-84a3-4484-9af3-7a721ba39201,network=Network(decf3cff-055f-4d6b-9784-4cd1aa517767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8061d712-84') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:99:3f,bridge_name='br-int',has_traffic_filtering=True,id=d4d60025-cd29-4e1d-a98c-d4c6e222914f,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4d60025-cd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=03bc5876-9344-412e-b868-0efe6d1a2b87,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03bc5876-93') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=64c7f448-31f1-4983-8137-35563482e00c,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c7f448-31') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:a5:74,bridge_name='br-int',has_traffic_filtering=True,id=e8c4fb3e-981c-45b4-9ed3-cea1605128fb,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c4fb3e-98') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf50bddc-3f74-4d9e-9003-e8075806a131", "address": "fa:16:3e:5e:15:67", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf50bddc-3f", "ovs_interfaceid": "bf50bddc-3f74-4d9e-9003-e8075806a131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "bf50bddc-3f74-4d9e-9003-e8075806a131", "address": "fa:16:3e:5e:15:67", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf50bddc-3f", "ovs_interfaceid": "bf50bddc-3f74-4d9e-9003-e8075806a131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bf50bddc-3f74-4d9e-9003-e8075806a131,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf50bddc-3f') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:86:ab,bridge_name='br-int',has_traffic_filtering=True,id=a4197c5a-1660-4d86-97ce-ac19cbc419a9,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4197c5a-16') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.objects.instance [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lazy-loading 'pci_devices' on Instance uuid f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:38:24 user nova-compute[75993]:   <uuid>f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1</uuid>
Nov 08 21:38:24 user nova-compute[75993]:   <name>instance-0000000c</name>
Nov 08 21:38:24 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:38:24 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:38:24 user nova-compute[75993]:   <metadata>
Nov 08 21:38:24 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:38:24 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:38:24 user nova-compute[75993]:       <nova:name>tempest-device-tagging-server-131849376</nova:name>
Nov 08 21:38:24 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:38:20</nova:creationTime>
Nov 08 21:38:24 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:38:24 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:38:24 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:38:24 user nova-compute[75993]:       <nova:owner>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:user uuid="6147fd63937f48389f54a418c8ba2a21">tempest-TaggedBootDevicesTest-1945801815-project-member</nova:user>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:project uuid="e1e556b7998d44018428c2753f5d22df">tempest-TaggedBootDevicesTest-1945801815</nova:project>
Nov 08 21:38:24 user nova-compute[75993]:       </nova:owner>
Nov 08 21:38:24 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:38:24 user nova-compute[75993]:       <nova:ports>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:port uuid="8061d712-84a3-4484-9af3-7a721ba39201">
Nov 08 21:38:24 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 21:38:24 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:port uuid="d4d60025-cd29-4e1d-a98c-d4c6e222914f">
Nov 08 21:38:24 user nova-compute[75993]:           <nova:ip type="fixed" address="10.1.1.198" ipVersion="4"/>
Nov 08 21:38:24 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:port uuid="03bc5876-9344-412e-b868-0efe6d1a2b87">
Nov 08 21:38:24 user nova-compute[75993]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
Nov 08 21:38:24 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:port uuid="64c7f448-31f1-4983-8137-35563482e00c">
Nov 08 21:38:24 user nova-compute[75993]:           <nova:ip type="fixed" address="10.1.1.152" ipVersion="4"/>
Nov 08 21:38:24 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:port uuid="e8c4fb3e-981c-45b4-9ed3-cea1605128fb">
Nov 08 21:38:24 user nova-compute[75993]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Nov 08 21:38:24 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:port uuid="bf50bddc-3f74-4d9e-9003-e8075806a131">
Nov 08 21:38:24 user nova-compute[75993]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 21:38:24 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:24 user nova-compute[75993]:         <nova:port uuid="a4197c5a-1660-4d86-97ce-ac19cbc419a9">
Nov 08 21:38:24 user nova-compute[75993]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 21:38:24 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:24 user nova-compute[75993]:       </nova:ports>
Nov 08 21:38:24 user nova-compute[75993]:     </nova:instance>
Nov 08 21:38:24 user nova-compute[75993]:   </metadata>
Nov 08 21:38:24 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:38:24 user nova-compute[75993]:     <system>
Nov 08 21:38:24 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:38:24 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:38:24 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:38:24 user nova-compute[75993]:       <entry name="serial">f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1</entry>
Nov 08 21:38:24 user nova-compute[75993]:       <entry name="uuid">f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1</entry>
Nov 08 21:38:24 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:38:24 user nova-compute[75993]:     </system>
Nov 08 21:38:24 user nova-compute[75993]:   </sysinfo>
Nov 08 21:38:24 user nova-compute[75993]:   <os>
Nov 08 21:38:24 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:38:24 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:38:24 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:38:24 user nova-compute[75993]:   </os>
Nov 08 21:38:24 user nova-compute[75993]:   <features>
Nov 08 21:38:24 user nova-compute[75993]:     <acpi/>
Nov 08 21:38:24 user nova-compute[75993]:     <apic/>
Nov 08 21:38:24 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:38:24 user nova-compute[75993]:   </features>
Nov 08 21:38:24 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:38:24 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:38:24 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:38:24 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:38:24 user nova-compute[75993]:   </clock>
Nov 08 21:38:24 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:38:24 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:38:24 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:38:24 user nova-compute[75993]:   </cpu>
Nov 08 21:38:24 user nova-compute[75993]:   <devices>
Nov 08 21:38:24 user nova-compute[75993]:     <disk type="file" device="cdrom">
Nov 08 21:38:24 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 21:38:24 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1/disk.config"/>
Nov 08 21:38:24 user nova-compute[75993]:       <target dev="hda" bus="ide"/>
Nov 08 21:38:24 user nova-compute[75993]:     </disk>
Nov 08 21:38:24 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:38:24 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:24 user nova-compute[75993]:       <source dev="/dev/sdh"/>
Nov 08 21:38:24 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:38:24 user nova-compute[75993]:       <serial>878fed90-8eac-4987-9bd7-bf3aa880998d</serial>
Nov 08 21:38:24 user nova-compute[75993]:     </disk>
Nov 08 21:38:24 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:38:24 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:24 user nova-compute[75993]:       <source dev="/dev/sdi"/>
Nov 08 21:38:24 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:38:24 user nova-compute[75993]:       <serial>abd64a7d-2eb8-498d-996d-53642e92234a</serial>
Nov 08 21:38:24 user nova-compute[75993]:     </disk>
Nov 08 21:38:24 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:38:24 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:24 user nova-compute[75993]:       <source dev="/dev/sdj"/>
Nov 08 21:38:24 user nova-compute[75993]:       <target dev="vdc" bus="virtio"/>
Nov 08 21:38:24 user nova-compute[75993]:       <serial>a393c62a-ed47-4239-9da3-88971b8318d2</serial>
Nov 08 21:38:24 user nova-compute[75993]:     </disk>
Nov 08 21:38:24 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:24 user nova-compute[75993]:       <mac address="fa:16:3e:6f:a0:da"/>
Nov 08 21:38:24 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:24 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:24 user nova-compute[75993]:       <target dev="tap8061d712-84"/>
Nov 08 21:38:24 user nova-compute[75993]:     </interface>
Nov 08 21:38:24 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:24 user nova-compute[75993]:       <mac address="fa:16:3e:d4:99:3f"/>
Nov 08 21:38:24 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:24 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:24 user nova-compute[75993]:       <target dev="tapd4d60025-cd"/>
Nov 08 21:38:24 user nova-compute[75993]:     </interface>
Nov 08 21:38:24 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:24 user nova-compute[75993]:       <mac address="fa:16:3e:dd:2d:d9"/>
Nov 08 21:38:24 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:24 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:24 user nova-compute[75993]:       <target dev="tap03bc5876-93"/>
Nov 08 21:38:24 user nova-compute[75993]:     </interface>
Nov 08 21:38:24 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:24 user nova-compute[75993]:       <mac address="fa:16:3e:f5:1b:26"/>
Nov 08 21:38:24 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:24 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:24 user nova-compute[75993]:       <target dev="tap64c7f448-31"/>
Nov 08 21:38:24 user nova-compute[75993]:     </interface>
Nov 08 21:38:24 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:24 user nova-compute[75993]:       <mac address="fa:16:3e:10:a5:74"/>
Nov 08 21:38:24 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:24 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:24 user nova-compute[75993]:       <target dev="tape8c4fb3e-98"/>
Nov 08 21:38:24 user nova-compute[75993]:     </interface>
Nov 08 21:38:24 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:24 user nova-compute[75993]:       <mac address="fa:16:3e:5e:15:67"/>
Nov 08 21:38:24 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:24 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:24 user nova-compute[75993]:       <target dev="tapbf50bddc-3f"/>
Nov 08 21:38:24 user nova-compute[75993]:     </interface>
Nov 08 21:38:24 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:24 user nova-compute[75993]:       <mac address="fa:16:3e:3f:86:ab"/>
Nov 08 21:38:24 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:24 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:24 user nova-compute[75993]:       <target dev="tapa4197c5a-16"/>
Nov 08 21:38:24 user nova-compute[75993]:     </interface>
Nov 08 21:38:24 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:38:24 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1/console.log" append="off"/>
Nov 08 21:38:24 user nova-compute[75993]:     </serial>
Nov 08 21:38:24 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:38:24 user nova-compute[75993]:     <video>
Nov 08 21:38:24 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:24 user nova-compute[75993]:     </video>
Nov 08 21:38:24 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:38:24 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:38:24 user nova-compute[75993]:     </rng>
Nov 08 21:38:24 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:38:24 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:38:24 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:38:24 user nova-compute[75993]:     </memballoon>
Nov 08 21:38:24 user nova-compute[75993]:   </devices>
Nov 08 21:38:24 user nova-compute[75993]: </domain>
Nov 08 21:38:24 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:a0:da,bridge_name='br-int',has_traffic_filtering=True,id=8061d712-84a3-4484-9af3-7a721ba39201,network=Network(decf3cff-055f-4d6b-9784-4cd1aa517767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8061d712-84') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:a0:da,bridge_name='br-int',has_traffic_filtering=True,id=8061d712-84a3-4484-9af3-7a721ba39201,network=Network(decf3cff-055f-4d6b-9784-4cd1aa517767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8061d712-84') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '809b84db-8d82-5ba9-81d6-cce423dec876', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8061d712-84, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8061d712-84, col_values=(('qos', UUID('27176fb1-f843-48e2-b4d2-9a952f943134')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8061d712-84, col_values=(('external_ids', {'iface-id': '8061d712-84a3-4484-9af3-7a721ba39201', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:a0:da', 'vm-uuid': 'f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: INFO os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:a0:da,bridge_name='br-int',has_traffic_filtering=True,id=8061d712-84a3-4484-9af3-7a721ba39201,network=Network(decf3cff-055f-4d6b-9784-4cd1aa517767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8061d712-84')
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:99:3f,bridge_name='br-int',has_traffic_filtering=True,id=d4d60025-cd29-4e1d-a98c-d4c6e222914f,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4d60025-cd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:99:3f,bridge_name='br-int',has_traffic_filtering=True,id=d4d60025-cd29-4e1d-a98c-d4c6e222914f,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4d60025-cd') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b4830ab-590b-5263-b6b4-9acae7c61955', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4d60025-cd, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4d60025-cd, col_values=(('qos', UUID('6ca12b47-63c2-461d-8445-f168c552d112')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4d60025-cd, col_values=(('external_ids', {'iface-id': 'd4d60025-cd29-4e1d-a98c-d4c6e222914f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:99:3f', 'vm-uuid': 'f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: INFO os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:99:3f,bridge_name='br-int',has_traffic_filtering=True,id=d4d60025-cd29-4e1d-a98c-d4c6e222914f,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4d60025-cd')
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=03bc5876-9344-412e-b868-0efe6d1a2b87,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03bc5876-93') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=03bc5876-9344-412e-b868-0efe6d1a2b87,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03bc5876-93') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a1cdcca-dd9d-5810-9fa9-a081ec10e870', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03bc5876-93, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03bc5876-93, col_values=(('qos', UUID('2ea69c58-26ef-4b76-b071-33c4af41dbbe')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03bc5876-93, col_values=(('external_ids', {'iface-id': '03bc5876-9344-412e-b868-0efe6d1a2b87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:2d:d9', 'vm-uuid': 'f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: INFO os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=03bc5876-9344-412e-b868-0efe6d1a2b87,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03bc5876-93')
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=64c7f448-31f1-4983-8137-35563482e00c,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c7f448-31') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=64c7f448-31f1-4983-8137-35563482e00c,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c7f448-31') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '312a9129-e73c-5590-b470-e422d7df2fed', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64c7f448-31, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64c7f448-31, col_values=(('qos', UUID('e9d91e85-bac8-4e4b-8699-0dfb47ad4e2c')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64c7f448-31, col_values=(('external_ids', {'iface-id': '64c7f448-31f1-4983-8137-35563482e00c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:1b:26', 'vm-uuid': 'f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: INFO os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=64c7f448-31f1-4983-8137-35563482e00c,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c7f448-31')
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:a5:74,bridge_name='br-int',has_traffic_filtering=True,id=e8c4fb3e-981c-45b4-9ed3-cea1605128fb,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c4fb3e-98') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:a5:74,bridge_name='br-int',has_traffic_filtering=True,id=e8c4fb3e-981c-45b4-9ed3-cea1605128fb,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c4fb3e-98') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed92347f-f64f-5b6b-8797-b861d1caf23f', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8c4fb3e-98, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8c4fb3e-98, col_values=(('qos', UUID('24efbc1e-eb84-462f-8f1d-514f13faf265')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8c4fb3e-98, col_values=(('external_ids', {'iface-id': 'e8c4fb3e-981c-45b4-9ed3-cea1605128fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:a5:74', 'vm-uuid': 'f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: INFO os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:a5:74,bridge_name='br-int',has_traffic_filtering=True,id=e8c4fb3e-981c-45b4-9ed3-cea1605128fb,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c4fb3e-98')
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf50bddc-3f74-4d9e-9003-e8075806a131", "address": "fa:16:3e:5e:15:67", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf50bddc-3f", "ovs_interfaceid": "bf50bddc-3f74-4d9e-9003-e8075806a131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "bf50bddc-3f74-4d9e-9003-e8075806a131", "address": "fa:16:3e:5e:15:67", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf50bddc-3f", "ovs_interfaceid": "bf50bddc-3f74-4d9e-9003-e8075806a131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bf50bddc-3f74-4d9e-9003-e8075806a131,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf50bddc-3f') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bf50bddc-3f74-4d9e-9003-e8075806a131,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf50bddc-3f') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c9c41f9-543c-5ce6-9c92-ffb6394c6b9d', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf50bddc-3f, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf50bddc-3f, col_values=(('qos', UUID('4a57bd2d-a69d-4a20-8715-f104f45014d9')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf50bddc-3f, col_values=(('external_ids', {'iface-id': 'bf50bddc-3f74-4d9e-9003-e8075806a131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:15:67', 'vm-uuid': 'f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: INFO os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bf50bddc-3f74-4d9e-9003-e8075806a131,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf50bddc-3f')
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:86:ab,bridge_name='br-int',has_traffic_filtering=True,id=a4197c5a-1660-4d86-97ce-ac19cbc419a9,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4197c5a-16') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:86:ab,bridge_name='br-int',has_traffic_filtering=True,id=a4197c5a-1660-4d86-97ce-ac19cbc419a9,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4197c5a-16') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a34e3a3-adb4-5173-a1f2-a695fd5b0c0e', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4197c5a-16, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4197c5a-16, col_values=(('qos', UUID('88e1a5dc-3856-470f-94fc-a1a07df6b8c0')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4197c5a-16, col_values=(('external_ids', {'iface-id': 'a4197c5a-1660-4d86-97ce-ac19cbc419a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:86:ab', 'vm-uuid': 'f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: INFO os_vif [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:86:ab,bridge_name='br-int',has_traffic_filtering=True,id=a4197c5a-1660-4d86-97ce-ac19cbc419a9,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4197c5a-16')
Nov 08 21:38:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] No BDM found with device name hda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] No VIF found with MAC fa:16:3e:6f:a0:da, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] No VIF found with MAC fa:16:3e:10:a5:74, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:38:25 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Using config drive
Nov 08 21:38:25 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Creating config drive at /opt/stack/data/nova/instances/f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1/disk.config
Nov 08 21:38:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvk25opti {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpvk25opti" returned: 0 in 0.069s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-0149ff79-db5f-4087-8c9d-db735b92ea69 req-6ddcc64f-eeef-42f7-9e88-3108550a1ba5 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0149ff79-db5f-4087-8c9d-db735b92ea69 req-6ddcc64f-eeef-42f7-9e88-3108550a1ba5 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0149ff79-db5f-4087-8c9d-db735b92ea69 req-6ddcc64f-eeef-42f7-9e88-3108550a1ba5 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0149ff79-db5f-4087-8c9d-db735b92ea69 req-6ddcc64f-eeef-42f7-9e88-3108550a1ba5 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-0149ff79-db5f-4087-8c9d-db735b92ea69 req-6ddcc64f-eeef-42f7-9e88-3108550a1ba5 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:27 user nova-compute[75993]: WARNING nova.compute.manager [req-0149ff79-db5f-4087-8c9d-db735b92ea69 req-6ddcc64f-eeef-42f7-9e88-3108550a1ba5 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-8061d712-84a3-4484-9af3-7a721ba39201 for instance with vm_state building and task_state spawning.
Nov 08 21:38:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-465d94f5-7092-48a0-b95b-565dd66a62d3 req-cc593575-c292-4432-9266-3fba781db699 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-465d94f5-7092-48a0-b95b-565dd66a62d3 req-cc593575-c292-4432-9266-3fba781db699 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-465d94f5-7092-48a0-b95b-565dd66a62d3 req-cc593575-c292-4432-9266-3fba781db699 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-465d94f5-7092-48a0-b95b-565dd66a62d3 req-cc593575-c292-4432-9266-3fba781db699 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-465d94f5-7092-48a0-b95b-565dd66a62d3 req-cc593575-c292-4432-9266-3fba781db699 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:28 user nova-compute[75993]: WARNING nova.compute.manager [req-465d94f5-7092-48a0-b95b-565dd66a62d3 req-cc593575-c292-4432-9266-3fba781db699 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f for instance with vm_state building and task_state spawning.
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-a7aac67f-376b-42d6-8bf8-6494874a7542 req-0fc58a0a-09a6-4839-bc44-f5b965ed418c service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a7aac67f-376b-42d6-8bf8-6494874a7542 req-0fc58a0a-09a6-4839-bc44-f5b965ed418c service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a7aac67f-376b-42d6-8bf8-6494874a7542 req-0fc58a0a-09a6-4839-bc44-f5b965ed418c service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a7aac67f-376b-42d6-8bf8-6494874a7542 req-0fc58a0a-09a6-4839-bc44-f5b965ed418c service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-a7aac67f-376b-42d6-8bf8-6494874a7542 req-0fc58a0a-09a6-4839-bc44-f5b965ed418c service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:29 user nova-compute[75993]: WARNING nova.compute.manager [req-a7aac67f-376b-42d6-8bf8-6494874a7542 req-0fc58a0a-09a6-4839-bc44-f5b965ed418c service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-bf50bddc-3f74-4d9e-9003-e8075806a131 for instance with vm_state building and task_state spawning.
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:29 user nova-compute[75993]: WARNING nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-8061d712-84a3-4484-9af3-7a721ba39201 for instance with vm_state building and task_state spawning.
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:29 user nova-compute[75993]: WARNING nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-64c7f448-31f1-4983-8137-35563482e00c for instance with vm_state building and task_state spawning.
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:29 user nova-compute[75993]: WARNING nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-64c7f448-31f1-4983-8137-35563482e00c for instance with vm_state building and task_state spawning.
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:29 user nova-compute[75993]: WARNING nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb for instance with vm_state building and task_state spawning.
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:29 user nova-compute[75993]: WARNING nova.compute.manager [req-34305907-d75f-4d54-a005-6f01a3ff2b83 req-af52e85a-5676-4745-b80c-95d1a9823680 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb for instance with vm_state building and task_state spawning.
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:30 user nova-compute[75993]: WARNING nova.compute.manager [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f for instance with vm_state building and task_state spawning.
Nov 08 21:38:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-03bc5876-9344-412e-b868-0efe6d1a2b87 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-03bc5876-9344-412e-b868-0efe6d1a2b87 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:30 user nova-compute[75993]: WARNING nova.compute.manager [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-03bc5876-9344-412e-b868-0efe6d1a2b87 for instance with vm_state building and task_state spawning.
Nov 08 21:38:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-03bc5876-9344-412e-b868-0efe6d1a2b87 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-03bc5876-9344-412e-b868-0efe6d1a2b87 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:30 user nova-compute[75993]: WARNING nova.compute.manager [req-72cf910d-2a8c-420b-8713-e612d9abdd10 req-ed05c0a1-30b9-4064-bc56-ab31e5ea24df service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-03bc5876-9344-412e-b868-0efe6d1a2b87 for instance with vm_state building and task_state spawning.
Nov 08 21:38:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:31 user nova-compute[75993]: WARNING nova.compute.manager [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-bf50bddc-3f74-4d9e-9003-e8075806a131 for instance with vm_state building and task_state spawning.
Nov 08 21:38:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:31 user nova-compute[75993]: WARNING nova.compute.manager [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 for instance with vm_state building and task_state spawning.
Nov 08 21:38:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:31 user nova-compute[75993]: WARNING nova.compute.manager [req-42779ca1-3e88-4b37-b3a5-7418b99f031e req-a6b5de4d-46d0-405e-8129-aa5d858d003f service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 for instance with vm_state building and task_state spawning.
Nov 08 21:38:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:38:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:38:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Instance spawned successfully.
Nov 08 21:38:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:38:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:38:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:38:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:38:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:38:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:38:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:38:32 user nova-compute[75993]: INFO nova.compute.manager [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Took 12.06 seconds to spawn the instance on the hypervisor.
Nov 08 21:38:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:38:32 user nova-compute[75993]: INFO nova.compute.manager [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Took 151.77 seconds to build instance.
Nov 08 21:38:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8aafca78-71d1-48a1-abef-5dd30f3788a6 tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 151.910s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Acquiring lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Acquiring lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:33 user nova-compute[75993]: INFO nova.compute.manager [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Terminating instance
Nov 08 21:38:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-2ae0d630-83c1-498c-807d-ad7e810f0c15 req-2b96a6fe-cf3d-4f15-980e-c9064d0d4f73 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Received event network-vif-unplugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2ae0d630-83c1-498c-807d-ad7e810f0c15 req-2b96a6fe-cf3d-4f15-980e-c9064d0d4f73 service nova] Acquiring lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2ae0d630-83c1-498c-807d-ad7e810f0c15 req-2b96a6fe-cf3d-4f15-980e-c9064d0d4f73 service nova] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2ae0d630-83c1-498c-807d-ad7e810f0c15 req-2b96a6fe-cf3d-4f15-980e-c9064d0d4f73 service nova] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-2ae0d630-83c1-498c-807d-ad7e810f0c15 req-2b96a6fe-cf3d-4f15-980e-c9064d0d4f73 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] No waiting events found dispatching network-vif-unplugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-2ae0d630-83c1-498c-807d-ad7e810f0c15 req-2b96a6fe-cf3d-4f15-980e-c9064d0d4f73 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Received event network-vif-unplugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:38:34 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Instance destroyed successfully.
Nov 08 21:38:34 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lazy-loading 'resources' on Instance uuid d5c049a3-6f20-49d4-90df-e0222c2fdc8b {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:35:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-152548353',display_name='tempest-VolumesActionsTest-instance-152548353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-152548353',id=11,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:35:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66bdce5d588a45daa65fd80e83425874',ramdisk_id='',reservation_id='r-dz9ej7dk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1860683721',owner_user_name='tempest-VolumesActionsTest-1860683721-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:35:50Z,user_data=None,user_id='7ef5882a60864d00a7561128acad8549',uuid=d5c049a3-6f20-49d4-90df-e0222c2fdc8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "address": "fa:16:3e:8d:46:9a", "network": {"id": "cb466d33-80cb-4f0b-8d4f-883361f45943", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262491372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bdce5d588a45daa65fd80e83425874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a8076c-49", "ovs_interfaceid": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Converting VIF {"id": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "address": "fa:16:3e:8d:46:9a", "network": {"id": "cb466d33-80cb-4f0b-8d4f-883361f45943", "bridge": "br-int", "label": "tempest-VolumesActionsTest-262491372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "66bdce5d588a45daa65fd80e83425874", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a8076c-49", "ovs_interfaceid": "30a8076c-4978-4b97-89ba-9c7ad154caf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:46:9a,bridge_name='br-int',has_traffic_filtering=True,id=30a8076c-4978-4b97-89ba-9c7ad154caf5,network=Network(cb466d33-80cb-4f0b-8d4f-883361f45943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a8076c-49') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG os_vif [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:46:9a,bridge_name='br-int',has_traffic_filtering=True,id=30a8076c-4978-4b97-89ba-9c7ad154caf5,network=Network(cb466d33-80cb-4f0b-8d4f-883361f45943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a8076c-49') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30a8076c-49, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc687543-6346-48a0-ab09-396b016b0aef) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:34 user nova-compute[75993]: INFO os_vif [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:46:9a,bridge_name='br-int',has_traffic_filtering=True,id=30a8076c-4978-4b97-89ba-9c7ad154caf5,network=Network(cb466d33-80cb-4f0b-8d4f-883361f45943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a8076c-49')
Nov 08 21:38:34 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Deleting instance files /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b_del
Nov 08 21:38:34 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Deletion of /opt/stack/data/nova/instances/d5c049a3-6f20-49d4-90df-e0222c2fdc8b_del complete
Nov 08 21:38:34 user nova-compute[75993]: INFO nova.compute.manager [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 08 21:38:34 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:38:34 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:38:35 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Took 0.73 seconds to deallocate network for instance.
Nov 08 21:38:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-b3042ed5-99e0-403c-b859-6e6e9b97b142 req-e7b199f7-64bd-4fbf-9eeb-1fb3c744ee13 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Received event network-vif-deleted-30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:35 user nova-compute[75993]: INFO nova.compute.manager [req-b3042ed5-99e0-403c-b859-6e6e9b97b142 req-e7b199f7-64bd-4fbf-9eeb-1fb3c744ee13 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Neutron deleted interface 30a8076c-4978-4b97-89ba-9c7ad154caf5; detaching it from the instance and deleting it from the info cache
Nov 08 21:38:35 user nova-compute[75993]: DEBUG nova.network.neutron [req-b3042ed5-99e0-403c-b859-6e6e9b97b142 req-e7b199f7-64bd-4fbf-9eeb-1fb3c744ee13 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-b3042ed5-99e0-403c-b859-6e6e9b97b142 req-e7b199f7-64bd-4fbf-9eeb-1fb3c744ee13 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Detach interface failed, port_id=30a8076c-4978-4b97-89ba-9c7ad154caf5, reason: Instance d5c049a3-6f20-49d4-90df-e0222c2fdc8b could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-31afdbd6-a635-4840-adbe-3913dcd403bb req-74a41bc7-ca57-47ab-9e23-1a3bb6712514 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Received event network-vif-plugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31afdbd6-a635-4840-adbe-3913dcd403bb req-74a41bc7-ca57-47ab-9e23-1a3bb6712514 service nova] Acquiring lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31afdbd6-a635-4840-adbe-3913dcd403bb req-74a41bc7-ca57-47ab-9e23-1a3bb6712514 service nova] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31afdbd6-a635-4840-adbe-3913dcd403bb req-74a41bc7-ca57-47ab-9e23-1a3bb6712514 service nova] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-31afdbd6-a635-4840-adbe-3913dcd403bb req-74a41bc7-ca57-47ab-9e23-1a3bb6712514 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] No waiting events found dispatching network-vif-plugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:35 user nova-compute[75993]: WARNING nova.compute.manager [req-31afdbd6-a635-4840-adbe-3913dcd403bb req-74a41bc7-ca57-47ab-9e23-1a3bb6712514 service nova] [instance: d5c049a3-6f20-49d4-90df-e0222c2fdc8b] Received unexpected event network-vif-plugged-30a8076c-4978-4b97-89ba-9c7ad154caf5 for instance with vm_state deleted and task_state None.
Nov 08 21:38:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.611s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:36 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Deleted allocations for instance d5c049a3-6f20-49d4-90df-e0222c2fdc8b
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ce2de9ff-7788-43d4-87dc-b75527a82110 tempest-VolumesActionsTest-1860683721 tempest-VolumesActionsTest-1860683721-project-member] Lock "d5c049a3-6f20-49d4-90df-e0222c2fdc8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.629s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:36 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 is timed out.
Nov 08 21:38:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Successfully detached device vdb from instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 from the live domain config.
Nov 08 21:38:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WdzCjMHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:36 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0c8e07-c0d6-4f9c-a892-4779c90ef68f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:38:36 user nova-compute[75993]: No targets found.
Nov 08 21:38:36 user nova-compute[75993]: iSNS:
Nov 08 21:38:36 user nova-compute[75993]: No targets found.
Nov 08 21:38:36 user nova-compute[75993]: STATIC:
Nov 08 21:38:36 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed
Nov 08 21:38:36 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:36 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:36 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2
Nov 08 21:38:36 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:36 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:36 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:38:36 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:36 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:36 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4
Nov 08 21:38:36 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:36 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:36 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d
Nov 08 21:38:36 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:36 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:36 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:38:36 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:36 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:36 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc
Nov 08 21:38:36 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:36 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:36 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688
Nov 08 21:38:36 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:36 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:36 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a
Nov 08 21:38:36 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:36 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:36 user nova-compute[75993]: FIRMWARE:
Nov 08 21:38:36 user nova-compute[75993]: No targets found.
Nov 08 21:38:36 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:38:36 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:38:36 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4114e1a-49f8-4cf5-b6e6-73d239e55a7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd7473d-a322-4b73-b1a6-242caf2f6e19]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:36 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:36 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:36 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f856855c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb11c80-7790-4b47-ac6a-996a434ea9aa]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc256a7a-dc4a-4afa-b03a-6ebea2043d66]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e6752d-aeba-4f67-ab57-97f86c257a49]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0b1f5c-37d5-4b20-b879-42a428bb29b9]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3ad665-a260-4bb5-b687-e22a876bd5a4]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df8f491-c40f-42ba-bfbc-ebad3ff9dc36]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed, portal: 172.16.0.220,3260]
Nov 08 21:38:36 user nova-compute[75993]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:36 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:070a17f9-cc9c-4774-b207-2f8fee26f6ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8d48dd-717e-4075-a6a4-9f982320e23f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] <== disconnect_volume: return (438ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:37 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:38:38 user nova-compute[75993]: DEBUG nova.objects.instance [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lazy-loading 'flavor' on Instance uuid 0965adf7-0f82-4dfa-8d1d-8dafb805a132 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cc4d4f79-c7cf-4daa-95a6-1e02c14a0e54 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.458s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:41 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c68ac7dc-3b4f-4d34-946d-86e8726c38af is timed out.
Nov 08 21:38:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Successfully detached device vdb from instance c68ac7dc-3b4f-4d34-946d-86e8726c38af from the live domain config.
Nov 08 21:38:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lkVzEnJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:41 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7827b0b3-de32-4b34-85f0-db0246ebfc2e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:38:41 user nova-compute[75993]: No targets found.
Nov 08 21:38:41 user nova-compute[75993]: iSNS:
Nov 08 21:38:41 user nova-compute[75993]: No targets found.
Nov 08 21:38:41 user nova-compute[75993]: STATIC:
Nov 08 21:38:41 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2
Nov 08 21:38:41 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:41 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:41 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:38:41 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:41 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:41 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4
Nov 08 21:38:41 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:41 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:41 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d
Nov 08 21:38:41 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:41 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:41 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:38:41 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:41 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:41 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc
Nov 08 21:38:41 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:41 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:41 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688
Nov 08 21:38:41 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:41 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:41 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a
Nov 08 21:38:41 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:41 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:41 user nova-compute[75993]: FIRMWARE:
Nov 08 21:38:41 user nova-compute[75993]: No targets found.
Nov 08 21:38:41 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:38:41 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:38:41 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf7fe54-f4f6-40af-9850-8a7ef76c186c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[973d5f36-c3ca-40e6-99c4-86e45aa9a4f2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:41 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:41 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:41 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544ea5fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688'): ({'sdf'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Removing single pathed devices sdf {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[242e4eca-bc9b-4e4f-8c9b-27271bd61cae]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[53af07ea-d817-4787-b5ab-132427667409]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Flushing IO for device /dev/sdf {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3655d346-db40-499e-bbd1-a0d5e82627a4]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6c2ed7-4855-42ba-92e1-41725babc091]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] SCSI volumes sdf have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02a1237-c349-4825-b819-6d7a03cfe5f1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[133d1192-af06-4a54-b97b-22fe0b456734]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688, portal: 172.16.0.220,3260]
Nov 08 21:38:41 user nova-compute[75993]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:41 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7e5b674-0bed-467b-8ada-382ee2164688 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa03e045-32ac-4b03-b0a1-90249764bbec]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] <== disconnect_volume: return (385ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:38:41 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1a014eaf-7813-445b-b783-282ea30f034c is timed out.
Nov 08 21:38:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Successfully detached device vdb from instance 1a014eaf-7813-445b-b783-282ea30f034c from the live domain config.
Nov 08 21:38:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CyLnAcbH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:41 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e170bdb3-d9cb-44f2-8b71-e0bf75a4ec2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:38:42 user nova-compute[75993]: No targets found.
Nov 08 21:38:42 user nova-compute[75993]: iSNS:
Nov 08 21:38:42 user nova-compute[75993]: No targets found.
Nov 08 21:38:42 user nova-compute[75993]: STATIC:
Nov 08 21:38:42 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2
Nov 08 21:38:42 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:42 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:42 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:38:42 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:42 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:42 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4
Nov 08 21:38:42 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:42 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:42 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d
Nov 08 21:38:42 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:42 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:42 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:38:42 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:42 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:42 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc
Nov 08 21:38:42 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:42 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:42 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a
Nov 08 21:38:42 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:42 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:42 user nova-compute[75993]: FIRMWARE:
Nov 08 21:38:42 user nova-compute[75993]: No targets found.
Nov 08 21:38:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:38:42 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:38:42 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[038c8316-b25e-4680-9969-44caa0248140]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[70106156-b72f-40d6-9cac-11f984152742]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 (non-flash)
Nov 08 21:38:42 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544ea7400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4'): ({'sdg'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Removing single pathed devices sdg {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b9e39c-a36c-40f0-afd4-ebee13fb89d9]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dd6a98-6864-49f9-a068-95a5d4a4fb62]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Flushing IO for device /dev/sdg {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[94512eb8-8860-4487-b843-cb454f2f6d24]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f961bdd7-6f1a-4249-9191-0e2ee610a184]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] SCSI volumes sdg have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b798e3bf-df31-469f-9f44-1c30b6dbd453]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6269c600-5ac5-481e-af7d-bd76ed3557a4]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4, portal: 172.16.0.220,3260]
Nov 08 21:38:42 user nova-compute[75993]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de7816ff-1d24-47fe-9ba4-254ac99a77c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd935e2b-3cf4-449e-b550-db10cc6032be]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] <== disconnect_volume: return (408ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lazy-loading 'flavor' on Instance uuid c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:43 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9bb5a995-4872-4671-91ab-ca0127d65181 is timed out.
Nov 08 21:38:43 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Successfully detached device vdb from instance 9bb5a995-4872-4671-91ab-ca0127d65181 from the live domain config.
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iMJKdYlP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:43 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61caf1a-a8d1-4c75-8ce0-587e2b43a6bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:38:43 user nova-compute[75993]: No targets found.
Nov 08 21:38:43 user nova-compute[75993]: iSNS:
Nov 08 21:38:43 user nova-compute[75993]: No targets found.
Nov 08 21:38:43 user nova-compute[75993]: STATIC:
Nov 08 21:38:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2
Nov 08 21:38:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:38:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d
Nov 08 21:38:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:38:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc
Nov 08 21:38:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a
Nov 08 21:38:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:43 user nova-compute[75993]: FIRMWARE:
Nov 08 21:38:43 user nova-compute[75993]: No targets found.
Nov 08 21:38:43 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:38:43 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:38:43 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7977a2-383d-499b-a794-f6b2a318bd69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7227650-b6c3-4819-9112-f3c518fa582a tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.763s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7468047-6e35-41f9-bd3d-d186ec8427d9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:43 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:43 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:43 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:43 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:43 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:43 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:43 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:43 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:43 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:43 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:43 user nova-compute[75993]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc (non-flash)
Nov 08 21:38:43 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544f91900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd03f11-9090-466b-980e-d3c1593f642a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "interface-c68ac7dc-3b4f-4d34-946d-86e8726c38af-21e2ed5b-c9b3-42f2-b19b-26fdb450de38" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "interface-c68ac7dc-3b4f-4d34-946d-86e8726c38af-21e2ed5b-c9b3-42f2-b19b-26fdb450de38" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee284dc-ed27-40cf-8a9e-4cc2a775cccc]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lazy-loading 'flavor' on Instance uuid c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e61ba6-f3c9-4a46-928c-d691a4838ab0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686990095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686990095',id=7,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIYNlWsNYNXIPzYxHJHsqWLqulGXulk0Teiy9wHphwJUB1UKtAxuCAT9/nMP58cJKIagHsE3mNVjHBFc2GKI4Bsmrn42N0sgHxg9hFcGJDRyLkXho/6LRS6t4SoMazlhg==',key_name='tempest-keypair-1407039979',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3144772c95b74eecbd2a1781114cfb77',ramdisk_id='',reservation_id='r-5deny31q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487427237',owner_user_name='tempest-TaggedAttachmentsTest-1487427237-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b13e1fc5636403f88aee213e6d70e7d',uuid=c68ac7dc-3b4f-4d34-946d-86e8726c38af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converting VIF {"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b7:2f:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tap21e2ed5b-c9"/></interface> {{(pid=75993) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b7:2f:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tap21e2ed5b-c9"/></interface> {{(pid=75993) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Attempting to detach device tap21e2ed5b-c9 from instance c68ac7dc-3b4f-4d34-946d-86e8726c38af from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] detach device xml: <interface type="ethernet">
Nov 08 21:38:43 user nova-compute[75993]:   <mac address="fa:16:3e:b7:2f:f0"/>
Nov 08 21:38:43 user nova-compute[75993]:   <model type="virtio"/>
Nov 08 21:38:43 user nova-compute[75993]:   <mtu size="1442"/>
Nov 08 21:38:43 user nova-compute[75993]:   <target dev="tap21e2ed5b-c9"/>
Nov 08 21:38:43 user nova-compute[75993]: </interface>
Nov 08 21:38:43 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d73051-0bb1-4707-887d-d94b04489040]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b7:2f:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tap21e2ed5b-c9"/></interface> {{(pid=75993) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b7:2f:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tap21e2ed5b-c9"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 21:38:43 user nova-compute[75993]:   <name>instance-00000007</name>
Nov 08 21:38:43 user nova-compute[75993]:   <uuid>c68ac7dc-3b4f-4d34-946d-86e8726c38af</uuid>
Nov 08 21:38:43 user nova-compute[75993]:   <metadata>
Nov 08 21:38:43 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:38:43 user nova-compute[75993]:   <nova:package version="0.0.0"/>
Nov 08 21:38:43 user nova-compute[75993]:   <nova:name>tempest-device-tagging-server-686990095</nova:name>
Nov 08 21:38:43 user nova-compute[75993]:   <nova:creationTime>2023-11-08 21:36:26</nova:creationTime>
Nov 08 21:38:43 user nova-compute[75993]:   <nova:flavor name="m1.tiny">
Nov 08 21:38:43 user nova-compute[75993]:     <nova:memory>512</nova:memory>
Nov 08 21:38:43 user nova-compute[75993]:     <nova:disk>1</nova:disk>
Nov 08 21:38:43 user nova-compute[75993]:     <nova:swap>0</nova:swap>
Nov 08 21:38:43 user nova-compute[75993]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:38:43 user nova-compute[75993]:     <nova:vcpus>1</nova:vcpus>
Nov 08 21:38:43 user nova-compute[75993]:   </nova:flavor>
Nov 08 21:38:43 user nova-compute[75993]:   <nova:owner>
Nov 08 21:38:43 user nova-compute[75993]:     <nova:user uuid="6b13e1fc5636403f88aee213e6d70e7d">tempest-TaggedAttachmentsTest-1487427237-project-member</nova:user>
Nov 08 21:38:43 user nova-compute[75993]:     <nova:project uuid="3144772c95b74eecbd2a1781114cfb77">tempest-TaggedAttachmentsTest-1487427237</nova:project>
Nov 08 21:38:43 user nova-compute[75993]:   </nova:owner>
Nov 08 21:38:43 user nova-compute[75993]:   <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:38:43 user nova-compute[75993]:   <nova:ports>
Nov 08 21:38:43 user nova-compute[75993]:     <nova:port uuid="d05110a2-8c3f-492e-8f02-77d7e07983cb">
Nov 08 21:38:43 user nova-compute[75993]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 21:38:43 user nova-compute[75993]:     </nova:port>
Nov 08 21:38:43 user nova-compute[75993]:     <nova:port uuid="21e2ed5b-c9b3-42f2-b19b-26fdb450de38">
Nov 08 21:38:43 user nova-compute[75993]:       <nova:ip type="fixed" address="10.10.10.128" ipVersion="4"/>
Nov 08 21:38:43 user nova-compute[75993]:     </nova:port>
Nov 08 21:38:43 user nova-compute[75993]:   </nova:ports>
Nov 08 21:38:43 user nova-compute[75993]: </nova:instance>
Nov 08 21:38:43 user nova-compute[75993]:   </metadata>
Nov 08 21:38:43 user nova-compute[75993]:   <memory unit='KiB'>524288</memory>
Nov 08 21:38:43 user nova-compute[75993]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 21:38:43 user nova-compute[75993]:   <vcpu placement='static'>1</vcpu>
Nov 08 21:38:43 user nova-compute[75993]:   <resource>
Nov 08 21:38:43 user nova-compute[75993]:     <partition>/machine</partition>
Nov 08 21:38:43 user nova-compute[75993]:   </resource>
Nov 08 21:38:43 user nova-compute[75993]:   <sysinfo type='smbios'>
Nov 08 21:38:43 user nova-compute[75993]:     <system>
Nov 08 21:38:43 user nova-compute[75993]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 21:38:43 user nova-compute[75993]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 21:38:43 user nova-compute[75993]:       <entry name='version'>0.0.0</entry>
Nov 08 21:38:43 user nova-compute[75993]:       <entry name='serial'>c68ac7dc-3b4f-4d34-946d-86e8726c38af</entry>
Nov 08 21:38:43 user nova-compute[75993]:       <entry name='uuid'>c68ac7dc-3b4f-4d34-946d-86e8726c38af</entry>
Nov 08 21:38:43 user nova-compute[75993]:       <entry name='family'>Virtual Machine</entry>
Nov 08 21:38:43 user nova-compute[75993]:     </system>
Nov 08 21:38:43 user nova-compute[75993]:   </sysinfo>
Nov 08 21:38:43 user nova-compute[75993]:   <os>
Nov 08 21:38:43 user nova-compute[75993]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 21:38:43 user nova-compute[75993]:     <boot dev='hd'/>
Nov 08 21:38:43 user nova-compute[75993]:     <smbios mode='sysinfo'/>
Nov 08 21:38:43 user nova-compute[75993]:   </os>
Nov 08 21:38:43 user nova-compute[75993]:   <features>
Nov 08 21:38:43 user nova-compute[75993]:     <acpi/>
Nov 08 21:38:43 user nova-compute[75993]:     <apic/>
Nov 08 21:38:43 user nova-compute[75993]:     <vmcoreinfo state='on'/>
Nov 08 21:38:43 user nova-compute[75993]:   </features>
Nov 08 21:38:43 user nova-compute[75993]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 21:38:43 user nova-compute[75993]:     <model fallback='forbid'>Nehalem</model>
Nov 08 21:38:43 user nova-compute[75993]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 21:38:43 user nova-compute[75993]:     <feature policy='require' name='vme'/>
Nov 08 21:38:43 user nova-compute[75993]:     <feature policy='require' name='x2apic'/>
Nov 08 21:38:43 user nova-compute[75993]:     <feature policy='require' name='hypervisor'/>
Nov 08 21:38:43 user nova-compute[75993]:   </cpu>
Nov 08 21:38:43 user nova-compute[75993]:   <clock offset='utc'>
Nov 08 21:38:43 user nova-compute[75993]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 21:38:43 user nova-compute[75993]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 21:38:43 user nova-compute[75993]:     <timer name='hpet' present='no'/>
Nov 08 21:38:43 user nova-compute[75993]:   </clock>
Nov 08 21:38:43 user nova-compute[75993]:   <on_poweroff>destroy</on_poweroff>
Nov 08 21:38:43 user nova-compute[75993]:   <on_reboot>restart</on_reboot>
Nov 08 21:38:43 user nova-compute[75993]:   <on_crash>destroy</on_crash>
Nov 08 21:38:43 user nova-compute[75993]:   <devices>
Nov 08 21:38:43 user nova-compute[75993]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 21:38:43 user nova-compute[75993]:     <disk type='file' device='disk'>
Nov 08 21:38:43 user nova-compute[75993]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 21:38:43 user nova-compute[75993]:       <source file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk' index='2'/>
Nov 08 21:38:43 user nova-compute[75993]:       <backingStore type='file' index='3'>
Nov 08 21:38:43 user nova-compute[75993]:         <format type='raw'/>
Nov 08 21:38:43 user nova-compute[75993]:         <source file='/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be'/>
Nov 08 21:38:43 user nova-compute[75993]:         <backingStore/>
Nov 08 21:38:43 user nova-compute[75993]:       </backingStore>
Nov 08 21:38:43 user nova-compute[75993]:       <target dev='vda' bus='virtio'/>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='virtio-disk0'/>
Nov 08 21:38:43 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </disk>
Nov 08 21:38:43 user nova-compute[75993]:     <disk type='file' device='cdrom'>
Nov 08 21:38:43 user nova-compute[75993]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 21:38:43 user nova-compute[75993]:       <source file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk.config' index='1'/>
Nov 08 21:38:43 user nova-compute[75993]:       <backingStore/>
Nov 08 21:38:43 user nova-compute[75993]:       <target dev='hda' bus='ide'/>
Nov 08 21:38:43 user nova-compute[75993]:       <readonly/>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='ide0-0-0'/>
Nov 08 21:38:43 user nova-compute[75993]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </disk>
Nov 08 21:38:43 user nova-compute[75993]:     <controller type='usb' index='0' model='none'>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='usb'/>
Nov 08 21:38:43 user nova-compute[75993]:     </controller>
Nov 08 21:38:43 user nova-compute[75993]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='pci.0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </controller>
Nov 08 21:38:43 user nova-compute[75993]:     <controller type='ide' index='0'>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='ide'/>
Nov 08 21:38:43 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 21:38:43 user nova-compute[75993]:     </controller>
Nov 08 21:38:43 user nova-compute[75993]:     <interface type='ethernet'>
Nov 08 21:38:43 user nova-compute[75993]:       <mac address='fa:16:3e:61:e1:be'/>
Nov 08 21:38:43 user nova-compute[75993]:       <target dev='tapd05110a2-8c'/>
Nov 08 21:38:43 user nova-compute[75993]:       <model type='virtio'/>
Nov 08 21:38:43 user nova-compute[75993]:       <mtu size='1442'/>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='net0'/>
Nov 08 21:38:43 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </interface>
Nov 08 21:38:43 user nova-compute[75993]:     <interface type='ethernet'>
Nov 08 21:38:43 user nova-compute[75993]:       <mac address='fa:16:3e:b7:2f:f0'/>
Nov 08 21:38:43 user nova-compute[75993]:       <target dev='tap21e2ed5b-c9'/>
Nov 08 21:38:43 user nova-compute[75993]:       <model type='virtio'/>
Nov 08 21:38:43 user nova-compute[75993]:       <mtu size='1442'/>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='net1'/>
Nov 08 21:38:43 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </interface>
Nov 08 21:38:43 user nova-compute[75993]:     <serial type='pty'>
Nov 08 21:38:43 user nova-compute[75993]:       <source path='/dev/pts/6'/>
Nov 08 21:38:43 user nova-compute[75993]:       <log file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/console.log' append='off'/>
Nov 08 21:38:43 user nova-compute[75993]:       <target type='isa-serial' port='0'>
Nov 08 21:38:43 user nova-compute[75993]:         <model name='isa-serial'/>
Nov 08 21:38:43 user nova-compute[75993]:       </target>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='serial0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </serial>
Nov 08 21:38:43 user nova-compute[75993]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 21:38:43 user nova-compute[75993]:       <source path='/dev/pts/6'/>
Nov 08 21:38:43 user nova-compute[75993]:       <log file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/console.log' append='off'/>
Nov 08 21:38:43 user nova-compute[75993]:       <target type='serial' port='0'/>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='serial0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </console>
Nov 08 21:38:43 user nova-compute[75993]:     <input type='mouse' bus='ps2'>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='input0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </input>
Nov 08 21:38:43 user nova-compute[75993]:     <input type='keyboard' bus='ps2'>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='input1'/>
Nov 08 21:38:43 user nova-compute[75993]:     </input>
Nov 08 21:38:43 user nova-compute[75993]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 21:38:43 user nova-compute[75993]:       <listen type='address' address='0.0.0.0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </graphics>
Nov 08 21:38:43 user nova-compute[75993]:     <audio id='1' type='none'/>
Nov 08 21:38:43 user nova-compute[75993]:     <video>
Nov 08 21:38:43 user nova-compute[75993]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='video0'/>
Nov 08 21:38:43 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </video>
Nov 08 21:38:43 user nova-compute[75993]:     <memballoon model='virtio'>
Nov 08 21:38:43 user nova-compute[75993]:       <stats period='10'/>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='balloon0'/>
Nov 08 21:38:43 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </memballoon>
Nov 08 21:38:43 user nova-compute[75993]:     <rng model='virtio'>
Nov 08 21:38:43 user nova-compute[75993]:       <backend model='random'>/dev/urandom</backend>
Nov 08 21:38:43 user nova-compute[75993]:       <alias name='rng0'/>
Nov 08 21:38:43 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 21:38:43 user nova-compute[75993]:     </rng>
Nov 08 21:38:43 user nova-compute[75993]:   </devices>
Nov 08 21:38:43 user nova-compute[75993]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 21:38:43 user nova-compute[75993]:     <label>libvirt-c68ac7dc-3b4f-4d34-946d-86e8726c38af</label>
Nov 08 21:38:43 user nova-compute[75993]:     <imagelabel>libvirt-c68ac7dc-3b4f-4d34-946d-86e8726c38af</imagelabel>
Nov 08 21:38:43 user nova-compute[75993]:   </seclabel>
Nov 08 21:38:43 user nova-compute[75993]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 21:38:43 user nova-compute[75993]:     <label>+64055:+108</label>
Nov 08 21:38:43 user nova-compute[75993]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 21:38:43 user nova-compute[75993]:   </seclabel>
Nov 08 21:38:43 user nova-compute[75993]: </domain>
Nov 08 21:38:43 user nova-compute[75993]:  {{(pid=75993) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 21:38:43 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Successfully detached device tap21e2ed5b-c9 from instance c68ac7dc-3b4f-4d34-946d-86e8726c38af from the persistent domain config.
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] (1/8): Attempting to detach device tap21e2ed5b-c9 with device alias net1 from instance c68ac7dc-3b4f-4d34-946d-86e8726c38af from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] detach device xml: <interface type="ethernet">
Nov 08 21:38:43 user nova-compute[75993]:   <mac address="fa:16:3e:b7:2f:f0"/>
Nov 08 21:38:43 user nova-compute[75993]:   <model type="virtio"/>
Nov 08 21:38:43 user nova-compute[75993]:   <mtu size="1442"/>
Nov 08 21:38:43 user nova-compute[75993]:   <target dev="tap21e2ed5b-c9"/>
Nov 08 21:38:43 user nova-compute[75993]: </interface>
Nov 08 21:38:43 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a19a5f-c144-4514-9293-aa316c6b465b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[80618600-4051-4212-83fe-50c785dbd892]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc, portal: 172.16.0.220,3260]
Nov 08 21:38:43 user nova-compute[75993]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:43 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcd93720-6537-47ac-8699-c725dce4affc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3176d8-5c32-4ce5-a008-6031ceb27b94]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] <== disconnect_volume: return (424ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Start waiting for the detach event from libvirt for device tap21e2ed5b-c9 with device alias net1 for instance c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtfNAmha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0d20870-4544-428f-8963-4e358845514c', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf0a422a-57f7-4f07-a32f-6d6a4845ba7b', 'serial': 'bf0a422a-57f7-4f07-a32f-6d6a4845ba7b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLDoRSAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'f0d20870-4544-428f-8963-4e358845514c', 'attached_at': '', 'detached_at': '', 'volume_id': '88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'serial'} {{(pid=75993) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtfNAmha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:43 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:43 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:43 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b1cb45-7e67-4608-8888-6e437c90f5f4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:38:43 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2ab79e-63bf-45d7-aa3a-de641de17b2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b] added
Nov 08 21:38:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-9aba1ef8-4da5-4916-9480-007c50caf35a req-7010efce-d8e1-46fc-bd81-eddf6ffeb92b service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-vif-unplugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9aba1ef8-4da5-4916-9480-007c50caf35a req-7010efce-d8e1-46fc-bd81-eddf6ffeb92b service nova] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9aba1ef8-4da5-4916-9480-007c50caf35a req-7010efce-d8e1-46fc-bd81-eddf6ffeb92b service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9aba1ef8-4da5-4916-9480-007c50caf35a req-7010efce-d8e1-46fc-bd81-eddf6ffeb92b service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-9aba1ef8-4da5-4916-9480-007c50caf35a req-7010efce-d8e1-46fc-bd81-eddf6ffeb92b service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] No waiting events found dispatching network-vif-unplugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:44 user nova-compute[75993]: WARNING nova.compute.manager [req-9aba1ef8-4da5-4916-9480-007c50caf35a req-7010efce-d8e1-46fc-bd81-eddf6ffeb92b service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received unexpected event network-vif-unplugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 for instance with vm_state active and task_state None.
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[730b8efe-3183-417c-a6ea-cc8e7dec1fa4]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca30e1c-d7ed-4818-b692-96b948986295]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtfNAmha {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtfNAmha" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af632bc-7432-461c-98e2-61abacd25902]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MtfNAmha'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d249f2cb-6462-48a6-8d0d-34481438bd60]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e398f735-7857-45d6-aedb-cc19104d0c01]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[302a12b6-1197-42b5-8e30-8f52cb2f8cd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b, portal: 172.16.0.220,3260]
Nov 08 21:38:44 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5731b21a-fac3-4fd3-a7a8-92a0e4afefce]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[def0c1f1-00db-49e8-ace5-e246dee7ca13]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:44 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[36873ff7-353d-459b-b588-1cf3c5584acf]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtfNAmha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG nova.objects.instance [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lazy-loading 'flavor' on Instance uuid 1a014eaf-7813-445b-b783-282ea30f034c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-70f0aa0d-db0c-4288-8dc6-6159f2e691ad tempest-VolumesAssistedSnapshotsTest-1787310802 tempest-VolumesAssistedSnapshotsTest-1787310802-project-admin] Lock "1a014eaf-7813-445b-b783-282ea30f034c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.224s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:45 user nova-compute[75993]: DEBUG nova.objects.instance [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lazy-loading 'flavor' on Instance uuid 9bb5a995-4872-4671-91ab-ca0127d65181 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bf856911-2d12-4e7b-ba87-2ac8765b6883 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.691s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23063316337636431', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063316337636431', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:38:45 user nova-compute[75993]: DEBUG nova.objects.instance [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lazy-loading 'flavor' on Instance uuid f0d20870-4544-428f-8963-4e358845514c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:38:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-16a000b9-28b3-422f-a251-61e100985660 req-ab3b8db7-f8ed-4d2b-9d58-80b6cf87f345 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-vif-plugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-16a000b9-28b3-422f-a251-61e100985660 req-ab3b8db7-f8ed-4d2b-9d58-80b6cf87f345 service nova] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-16a000b9-28b3-422f-a251-61e100985660 req-ab3b8db7-f8ed-4d2b-9d58-80b6cf87f345 service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-16a000b9-28b3-422f-a251-61e100985660 req-ab3b8db7-f8ed-4d2b-9d58-80b6cf87f345 service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-16a000b9-28b3-422f-a251-61e100985660 req-ab3b8db7-f8ed-4d2b-9d58-80b6cf87f345 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] No waiting events found dispatching network-vif-plugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:46 user nova-compute[75993]: WARNING nova.compute.manager [req-16a000b9-28b3-422f-a251-61e100985660 req-ab3b8db7-f8ed-4d2b-9d58-80b6cf87f345 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received unexpected event network-vif-plugged-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 for instance with vm_state active and task_state None.
Nov 08 21:38:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 89128960 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:38:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:38:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 244318208 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:38:47 user nova-compute[75993]: INFO nova.compute.manager [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Rescuing
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquired lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 395313152 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updating instance_info_cache with network_info: [{"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Releasing lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:38:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Creating image(s)
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Ensure instance console log exists: /opt/stack/data/nova/instances/81c8325d-776c-4171-86eb-26f83b7dde00/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Start _get_guest_xml network_info=[{"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '324fb985-90b0-4cd9-a9bb-19317d144ae2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veaQlbNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81c8325d-776c-4171-86eb-26f83b7dde00', 'attached_at': '', 'detached_at': '', 'volume_id': '3c928c86-706a-45a0-8855-74e227ade451', 'serial': '3c928c86-706a-45a0-8855-74e227ade451'}, 'volume_type': None}, {'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': 1, 'attachment_id': 'fd3e5cd2-7f52-4c77-ade2-78798b83624b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPjTfreM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81c8325d-776c-4171-86eb-26f83b7dde00', 'attached_at': '', 'detached_at': '', 'volume_id': '674908c5-638e-4e6e-ad65-81caac8d2be5', 'serial': '674908c5-638e-4e6e-ad65-81caac8d2be5'}, 'volume_type': None}, {'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': 2, 'attachment_id': 'fb9fe7b4-032c-4fbc-b9ed-1c234a7fd85e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIiOUKgW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81c8325d-776c-4171-86eb-26f83b7dde00', 'attached_at': '', 'detached_at': '', 'volume_id': 'a51c11f4-ca9d-41f5-825c-baa074b93b47', 'serial': 'a51c11f4-ca9d-41f5-825c-baa074b93b47'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:38:47 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:38:47 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veaQlbNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:47 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:47 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:47 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3d282c-7f79-4c44-943f-7bc567f49204]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:38:47 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 540016640 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15c7890-f001-419f-a4aa-d4b230350e07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451] added
Nov 08 21:38:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[486a9633-822c-4f2b-8323-6985a2bdf139]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4c8f38-5190-4dce-ba8f-4a917c0ad7f1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veaQlbNJ {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v veaQlbNJ" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72a0a42-160e-49bd-a72e-c9cd12009ddd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'veaQlbNJ'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c909272-a913-4de9-90e5-134dc9dc277e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8e109a-c195-4560-a2e2-1f0e54533a49]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --login" returned: 0 in 0.123s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c53c503-b2b3-4d62-81cd-d4dc28548812]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451, portal: 172.16.0.220,3260]
Nov 08 21:38:48 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0ca7c4-a881-4aea-a50f-cebe5406e5b0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f88141-7f01-4d81-8200-b17706879c3e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:48 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54a3fbc-f987-4eba-b2dc-bac46076f3da]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 680525824 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-1b1834a7-4a1a-4ce9-a5f5-98ebf7178bff req-39ea19db-ac7e-477e-aecd-9ac4cb383f0f service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1b1834a7-4a1a-4ce9-a5f5-98ebf7178bff req-39ea19db-ac7e-477e-aecd-9ac4cb383f0f service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1b1834a7-4a1a-4ce9-a5f5-98ebf7178bff req-39ea19db-ac7e-477e-aecd-9ac4cb383f0f service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1b1834a7-4a1a-4ce9-a5f5-98ebf7178bff req-39ea19db-ac7e-477e-aecd-9ac4cb383f0f service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-1b1834a7-4a1a-4ce9-a5f5-98ebf7178bff req-39ea19db-ac7e-477e-aecd-9ac4cb383f0f service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:48 user nova-compute[75993]: WARNING nova.compute.manager [req-1b1834a7-4a1a-4ce9-a5f5-98ebf7178bff req-39ea19db-ac7e-477e-aecd-9ac4cb383f0f service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state active and task_state rescuing.
Nov 08 21:38:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:38:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Instance destroyed successfully.
Nov 08 21:38:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Attempting rescue
Nov 08 21:38:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75993) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Instance directory exists: not creating {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 21:38:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Creating image(s)
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "/opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG nova.objects.instance [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'trusted_certs' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 789577728 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.227s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.rescue {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.rescue" returned: 0 in 0.061s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.objects.instance [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'migration_context' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.objects.base [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<adef30df-4254-4133-9db2-4c7708cd1996> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Start _get_guest_xml network_info=[{"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "vif_mac": "fa:16:3e:85:c5:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.objects.instance [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'resources' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.objects.base [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<adef30df-4254-4133-9db2-4c7708cd1996> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.objects.instance [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'numa_topology' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.objects.base [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<adef30df-4254-4133-9db2-4c7708cd1996> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:38:49 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:38:49 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.objects.instance [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'vcpu_model' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.objects.base [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<adef30df-4254-4133-9db2-4c7708cd1996> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-55830472',display_name='tempest-ServerRescueNegativeTestJSON-server-55830472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-55830472',id=1,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-30861mpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:34:15Z,user_data=None,user_id='37e02c3f49f1467498623a47a979a65d',uuid=adef30df-4254-4133-9db2-4c7708cd1996,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "vif_mac": "fa:16:3e:85:c5:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "vif_mac": "fa:16:3e:85:c5:88"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:c5:88,bridge_name='br-int',has_traffic_filtering=True,id=b8ee949d-fc2c-4df0-811f-eca62af20a5c,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ee949d-fc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.objects.instance [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'pci_devices' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veaQlbNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.520s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] <== connect_volume: return (1522ms) {'type': 'block', 'scsi_wwn': '26235393762626336', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235393762626336', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.objects.base [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<adef30df-4254-4133-9db2-4c7708cd1996> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:38:49 user nova-compute[75993]:   <uuid>adef30df-4254-4133-9db2-4c7708cd1996</uuid>
Nov 08 21:38:49 user nova-compute[75993]:   <name>instance-00000001</name>
Nov 08 21:38:49 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:38:49 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:38:49 user nova-compute[75993]:   <metadata>
Nov 08 21:38:49 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:38:49 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:38:49 user nova-compute[75993]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-55830472</nova:name>
Nov 08 21:38:49 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:38:49</nova:creationTime>
Nov 08 21:38:49 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:38:49 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:38:49 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:38:49 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:38:49 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:38:49 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:38:49 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:38:49 user nova-compute[75993]:       <nova:owner>
Nov 08 21:38:49 user nova-compute[75993]:         <nova:user uuid="37e02c3f49f1467498623a47a979a65d">tempest-ServerRescueNegativeTestJSON-1699992008-project-member</nova:user>
Nov 08 21:38:49 user nova-compute[75993]:         <nova:project uuid="b1b3b0aa87ce49949be27025c497a432">tempest-ServerRescueNegativeTestJSON-1699992008</nova:project>
Nov 08 21:38:49 user nova-compute[75993]:       </nova:owner>
Nov 08 21:38:49 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:38:49 user nova-compute[75993]:       <nova:ports>
Nov 08 21:38:49 user nova-compute[75993]:         <nova:port uuid="b8ee949d-fc2c-4df0-811f-eca62af20a5c">
Nov 08 21:38:49 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 21:38:49 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:49 user nova-compute[75993]:       </nova:ports>
Nov 08 21:38:49 user nova-compute[75993]:     </nova:instance>
Nov 08 21:38:49 user nova-compute[75993]:   </metadata>
Nov 08 21:38:49 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:38:49 user nova-compute[75993]:     <system>
Nov 08 21:38:49 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:38:49 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:38:49 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:38:49 user nova-compute[75993]:       <entry name="serial">adef30df-4254-4133-9db2-4c7708cd1996</entry>
Nov 08 21:38:49 user nova-compute[75993]:       <entry name="uuid">adef30df-4254-4133-9db2-4c7708cd1996</entry>
Nov 08 21:38:49 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:38:49 user nova-compute[75993]:     </system>
Nov 08 21:38:49 user nova-compute[75993]:   </sysinfo>
Nov 08 21:38:49 user nova-compute[75993]:   <os>
Nov 08 21:38:49 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:38:49 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:38:49 user nova-compute[75993]:   </os>
Nov 08 21:38:49 user nova-compute[75993]:   <features>
Nov 08 21:38:49 user nova-compute[75993]:     <acpi/>
Nov 08 21:38:49 user nova-compute[75993]:     <apic/>
Nov 08 21:38:49 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:38:49 user nova-compute[75993]:   </features>
Nov 08 21:38:49 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:38:49 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:38:49 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:38:49 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:38:49 user nova-compute[75993]:   </clock>
Nov 08 21:38:49 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:38:49 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:38:49 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:38:49 user nova-compute[75993]:   </cpu>
Nov 08 21:38:49 user nova-compute[75993]:   <devices>
Nov 08 21:38:49 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:38:49 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:38:49 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.rescue"/>
Nov 08 21:38:49 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:38:49 user nova-compute[75993]:     </disk>
Nov 08 21:38:49 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:38:49 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:38:49 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk"/>
Nov 08 21:38:49 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:38:49 user nova-compute[75993]:     </disk>
Nov 08 21:38:49 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:49 user nova-compute[75993]:       <mac address="fa:16:3e:85:c5:88"/>
Nov 08 21:38:49 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:49 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:49 user nova-compute[75993]:       <target dev="tapb8ee949d-fc"/>
Nov 08 21:38:49 user nova-compute[75993]:     </interface>
Nov 08 21:38:49 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:38:49 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/console.log" append="off"/>
Nov 08 21:38:49 user nova-compute[75993]:     </serial>
Nov 08 21:38:49 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:38:49 user nova-compute[75993]:     <video>
Nov 08 21:38:49 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:49 user nova-compute[75993]:     </video>
Nov 08 21:38:49 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:38:49 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:38:49 user nova-compute[75993]:     </rng>
Nov 08 21:38:49 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:38:49 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:38:49 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:38:49 user nova-compute[75993]:     </memballoon>
Nov 08 21:38:49 user nova-compute[75993]:   </devices>
Nov 08 21:38:49 user nova-compute[75993]: </domain>
Nov 08 21:38:49 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 944766976 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:38:49 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Instance destroyed successfully.
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPjTfreM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:49 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:49 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:49 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[77acae33-3764-4d20-a345-31c811e69040]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:38:49 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No VIF found with MAC fa:16:3e:85:c5:88, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e45e36e-dbe4-417c-a029-f6e1454102ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5] added
Nov 08 21:38:49 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[481211c5-674e-4f88-9392-5c641fbffd0a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dc2625-e70b-4ecb-8455-bcfd74214e76]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPjTfreM {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yPjTfreM" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc741021-7137-46e3-8cb8-ae8c4f3aafcd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yPjTfreM'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9836dd09-9b8f-4d9c-9f0a-ac8568f00a30]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4756e4-6eda-4f41-9744-1aa7f161ba9a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Updating instance_info_cache with network_info: [{"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --login" returned: 0 in 0.112s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[868143e8-bc64-4663-b7be-ed7f1cdd5a80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5, portal: 172.16.0.220,3260]
Nov 08 21:38:49 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:49 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-0965adf7-0f82-4dfa-8d1d-8dafb805a132" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb62760-3795-4210-8041-da094065071f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e0fc2e-68f1-4d83-a404-aa70c664ad56]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:49 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:49 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9727a571-3430-4b62-8727-ec5a9cb92c0d]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:38:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPjTfreM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-506b6ed5-9ffd-48b0-b3e4-10d98ec0ce34 req-3215234c-4cda-48ac-8b0a-521c0b65f92d service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-506b6ed5-9ffd-48b0-b3e4-10d98ec0ce34 req-3215234c-4cda-48ac-8b0a-521c0b65f92d service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-506b6ed5-9ffd-48b0-b3e4-10d98ec0ce34 req-3215234c-4cda-48ac-8b0a-521c0b65f92d service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-506b6ed5-9ffd-48b0-b3e4-10d98ec0ce34 req-3215234c-4cda-48ac-8b0a-521c0b65f92d service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-506b6ed5-9ffd-48b0-b3e4-10d98ec0ce34 req-3215234c-4cda-48ac-8b0a-521c0b65f92d service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:50 user nova-compute[75993]: WARNING nova.compute.manager [req-506b6ed5-9ffd-48b0-b3e4-10d98ec0ce34 req-3215234c-4cda-48ac-8b0a-521c0b65f92d service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state active and task_state rescuing.
Nov 08 21:38:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:38:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLDoRSAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:50 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.477s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] <== connect_volume: return (1480ms) {'type': 'block', 'scsi_wwn': '26433366634313665', 'path': '/dev/sdf'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433366634313665', 'path': '/dev/sdf'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.110s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[44947d7a-e9e6-4f90-9f4a-2a234f3e87cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:38:51 user nova-compute[75993]: No targets found.
Nov 08 21:38:51 user nova-compute[75993]: iSNS:
Nov 08 21:38:51 user nova-compute[75993]: No targets found.
Nov 08 21:38:51 user nova-compute[75993]: STATIC:
Nov 08 21:38:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2
Nov 08 21:38:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451
Nov 08 21:38:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:38:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d
Nov 08 21:38:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5
Nov 08 21:38:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:38:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b
Nov 08 21:38:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a
Nov 08 21:38:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:38:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:38:51 user nova-compute[75993]: FIRMWARE:
Nov 08 21:38:51 user nova-compute[75993]: No targets found.
Nov 08 21:38:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:38:51 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:38:51 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIiOUKgW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:51 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b04ddb-0c69-4818-b1f7-4d3fe90d03c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea85e41-5c01-4a2e-846e-f11051b7630b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8594dd08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf'): ({'sdd'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Removing single pathed devices sdd {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f081661b-d915-41bb-a43b-53b677f1b777]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7908ab-1c22-4443-9922-b200a6019cb5]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Flushing IO for device /dev/sdd {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[242294d2-ef4f-4cd2-adf8-a514c0315c45]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1167f08-90c9-4491-960e-fd33ce88704d]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] SCSI volumes sdd have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6159243-c4d5-43ae-aeef-bcedc9cb32cf]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a62cc9-7f01-4f99-bce9-83c667b18106]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260]
Nov 08 21:38:51 user nova-compute[75993]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b0ecf0-a676-4e05-a67d-83c24d46e64c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] <== disconnect_volume: return (499ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.358s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:51 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:38:51 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[129ef7d0-ab35-4c8e-a8d9-9b92ee516fde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:38:51 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e10ff6-bb06-4425-b951-161299e8b497]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47] added
Nov 08 21:38:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtfNAmha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f0d20870-4544-428f-8963-4e358845514c', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf0a422a-57f7-4f07-a32f-6d6a4845ba7b', 'serial'} {{(pid=75993) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] swap_volume: removing Cinder connection for volume 88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf {{(pid=75993) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2887fe-d89a-4590-84fe-293cfe46cb1f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e2de6b-d0e9-451f-b5e4-7964c6bac052]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIiOUKgW {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YIiOUKgW" returned: 0 in 0.037s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e905062-937a-4025-8af2-f2afacd258d0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YIiOUKgW'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[30dd8956-f344-4b59-9ce8-56650c9d5317]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b270c17c-7b9a-4193-8fdd-4b3926672111]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4dafd5-51cc-48aa-8177-575f185b7ca2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47, portal: 172.16.0.220,3260]
Nov 08 21:38:51 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47, portal: 172.16.0.220,3260] successful.
Nov 08 21:38:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46258a5-1436-4d7b-8427-5c5fc9898ff5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3df943a-58db-4279-93ce-3f3f78c79ba9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:38:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7254d7b3-3248-4cf5-a8bd-b7f9f13a2c13]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:52 user nova-compute[75993]: WARNING nova.compute.manager [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state active and task_state rescuing.
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:52 user nova-compute[75993]: WARNING nova.compute.manager [req-bfc7b3b9-9269-400b-86e5-f0fa93d34038 req-e993899f-995b-4b57-bd10-eec3f0aee351 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state active and task_state rescuing.
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] swap_volume: Updating volume 88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "MtfNAmha", "auth_password": "XEHbPQOi5oWaxJ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "bf0a422a-57f7-4f07-a32f-6d6a4845ba7b"}, "status": "reserved", "instance": "f0d20870-4544-428f-8963-4e358845514c", "attached_at": "", "detached_at": "", "volume_id": "bf0a422a-57f7-4f07-a32f-6d6a4845ba7b", "serial": "bf0a422a-57f7-4f07-a32f-6d6a4845ba7b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'bf0a422a-57f7-4f07-a32f-6d6a4845ba7b', 'no_device': None, 'attachment_id': 'da4bb701-eb40-4601-9e00-dcbdb5dea202'} {{(pid=75993) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4696d8e1-0c7b-4b46-98f2-512d2ca2ca59 tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "f0d20870-4544-428f-8963-4e358845514c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 64.685s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIiOUKgW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] <== connect_volume: return (1807ms) {'type': 'block', 'scsi_wwn': '23539386637383233', 'path': '/dev/sdd'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539386637383233', 'path': '/dev/sdd'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=be74d5f7-6805-471f-8295-c60479f28e95,network=Network(629177fb-a069-4ada-a59d-705ad78c6943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe74d5f7-68') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:af:28,bridge_name='br-int',has_traffic_filtering=True,id=973638d8-8c22-4d53-9354-277bb212f9a0,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap973638d8-8c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=65d1813e-7468-4b8f-b601-919421486512,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65d1813e-74') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4f:48,bridge_name='br-int',has_traffic_filtering=True,id=73dee529-8844-464d-8f84-9f9abd1f77b3,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dee529-88') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ec:aa,bridge_name='br-int',has_traffic_filtering=True,id=3824792e-3b3f-42e8-88de-ea963abd8625,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3824792e-3b') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:3a:ca,bridge_name='br-int',has_traffic_filtering=True,id=6c5e3135-2e49-4589-8f5c-dd9c75622f91,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5e3135-2e') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:e8:3a,bridge_name='br-int',has_traffic_filtering=True,id=d412b0c6-d5b0-4227-a40b-c6747d39448b,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd412b0c6-d5') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.objects.instance [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lazy-loading 'pci_devices' on Instance uuid 81c8325d-776c-4171-86eb-26f83b7dde00 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:38:52 user nova-compute[75993]:   <uuid>81c8325d-776c-4171-86eb-26f83b7dde00</uuid>
Nov 08 21:38:52 user nova-compute[75993]:   <name>instance-0000000d</name>
Nov 08 21:38:52 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:38:52 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:38:52 user nova-compute[75993]:   <metadata>
Nov 08 21:38:52 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:38:52 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:38:52 user nova-compute[75993]:       <nova:name>tempest-device-tagging-server-1214932199</nova:name>
Nov 08 21:38:52 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:38:47</nova:creationTime>
Nov 08 21:38:52 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:38:52 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:38:52 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:38:52 user nova-compute[75993]:       <nova:owner>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:user uuid="dbe48f7d4a2741eb8c641ff677ef7895">tempest-TaggedBootDevicesTest_v242-1197599497-project-member</nova:user>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:project uuid="4a11b5afb90b443f9a283b21bacbc822">tempest-TaggedBootDevicesTest_v242-1197599497</nova:project>
Nov 08 21:38:52 user nova-compute[75993]:       </nova:owner>
Nov 08 21:38:52 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:38:52 user nova-compute[75993]:       <nova:ports>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:port uuid="be74d5f7-6805-471f-8295-c60479f28e95">
Nov 08 21:38:52 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 21:38:52 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:port uuid="973638d8-8c22-4d53-9354-277bb212f9a0">
Nov 08 21:38:52 user nova-compute[75993]:           <nova:ip type="fixed" address="10.1.1.139" ipVersion="4"/>
Nov 08 21:38:52 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:port uuid="65d1813e-7468-4b8f-b601-919421486512">
Nov 08 21:38:52 user nova-compute[75993]:           <nova:ip type="fixed" address="10.1.1.78" ipVersion="4"/>
Nov 08 21:38:52 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:port uuid="73dee529-8844-464d-8f84-9f9abd1f77b3">
Nov 08 21:38:52 user nova-compute[75993]:           <nova:ip type="fixed" address="10.1.1.20" ipVersion="4"/>
Nov 08 21:38:52 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:port uuid="3824792e-3b3f-42e8-88de-ea963abd8625">
Nov 08 21:38:52 user nova-compute[75993]:           <nova:ip type="fixed" address="10.1.1.124" ipVersion="4"/>
Nov 08 21:38:52 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:port uuid="6c5e3135-2e49-4589-8f5c-dd9c75622f91">
Nov 08 21:38:52 user nova-compute[75993]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 08 21:38:52 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:52 user nova-compute[75993]:         <nova:port uuid="d412b0c6-d5b0-4227-a40b-c6747d39448b">
Nov 08 21:38:52 user nova-compute[75993]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 08 21:38:52 user nova-compute[75993]:         </nova:port>
Nov 08 21:38:52 user nova-compute[75993]:       </nova:ports>
Nov 08 21:38:52 user nova-compute[75993]:     </nova:instance>
Nov 08 21:38:52 user nova-compute[75993]:   </metadata>
Nov 08 21:38:52 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:38:52 user nova-compute[75993]:     <system>
Nov 08 21:38:52 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:38:52 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:38:52 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:38:52 user nova-compute[75993]:       <entry name="serial">81c8325d-776c-4171-86eb-26f83b7dde00</entry>
Nov 08 21:38:52 user nova-compute[75993]:       <entry name="uuid">81c8325d-776c-4171-86eb-26f83b7dde00</entry>
Nov 08 21:38:52 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:38:52 user nova-compute[75993]:     </system>
Nov 08 21:38:52 user nova-compute[75993]:   </sysinfo>
Nov 08 21:38:52 user nova-compute[75993]:   <os>
Nov 08 21:38:52 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:38:52 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:38:52 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:38:52 user nova-compute[75993]:   </os>
Nov 08 21:38:52 user nova-compute[75993]:   <features>
Nov 08 21:38:52 user nova-compute[75993]:     <acpi/>
Nov 08 21:38:52 user nova-compute[75993]:     <apic/>
Nov 08 21:38:52 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:38:52 user nova-compute[75993]:   </features>
Nov 08 21:38:52 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:38:52 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:38:52 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:38:52 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:38:52 user nova-compute[75993]:   </clock>
Nov 08 21:38:52 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:38:52 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:38:52 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:38:52 user nova-compute[75993]:   </cpu>
Nov 08 21:38:52 user nova-compute[75993]:   <devices>
Nov 08 21:38:52 user nova-compute[75993]:     <disk type="file" device="cdrom">
Nov 08 21:38:52 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 21:38:52 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/81c8325d-776c-4171-86eb-26f83b7dde00/disk.config"/>
Nov 08 21:38:52 user nova-compute[75993]:       <target dev="hda" bus="ide"/>
Nov 08 21:38:52 user nova-compute[75993]:     </disk>
Nov 08 21:38:52 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:38:52 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:52 user nova-compute[75993]:       <source dev="/dev/sdc"/>
Nov 08 21:38:52 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:38:52 user nova-compute[75993]:       <serial>3c928c86-706a-45a0-8855-74e227ade451</serial>
Nov 08 21:38:52 user nova-compute[75993]:     </disk>
Nov 08 21:38:52 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:38:52 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:52 user nova-compute[75993]:       <source dev="/dev/sdf"/>
Nov 08 21:38:52 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:38:52 user nova-compute[75993]:       <serial>674908c5-638e-4e6e-ad65-81caac8d2be5</serial>
Nov 08 21:38:52 user nova-compute[75993]:     </disk>
Nov 08 21:38:52 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:38:52 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:38:52 user nova-compute[75993]:       <source dev="/dev/sdd"/>
Nov 08 21:38:52 user nova-compute[75993]:       <target dev="vdc" bus="virtio"/>
Nov 08 21:38:52 user nova-compute[75993]:       <serial>a51c11f4-ca9d-41f5-825c-baa074b93b47</serial>
Nov 08 21:38:52 user nova-compute[75993]:     </disk>
Nov 08 21:38:52 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:52 user nova-compute[75993]:       <mac address="fa:16:3e:1a:ef:71"/>
Nov 08 21:38:52 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:52 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:52 user nova-compute[75993]:       <target dev="tapbe74d5f7-68"/>
Nov 08 21:38:52 user nova-compute[75993]:     </interface>
Nov 08 21:38:52 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:52 user nova-compute[75993]:       <mac address="fa:16:3e:72:af:28"/>
Nov 08 21:38:52 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:52 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:52 user nova-compute[75993]:       <target dev="tap973638d8-8c"/>
Nov 08 21:38:52 user nova-compute[75993]:     </interface>
Nov 08 21:38:52 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:52 user nova-compute[75993]:       <mac address="fa:16:3e:41:ef:8b"/>
Nov 08 21:38:52 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:52 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:52 user nova-compute[75993]:       <target dev="tap65d1813e-74"/>
Nov 08 21:38:52 user nova-compute[75993]:     </interface>
Nov 08 21:38:52 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:52 user nova-compute[75993]:       <mac address="fa:16:3e:a1:4f:48"/>
Nov 08 21:38:52 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:52 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:52 user nova-compute[75993]:       <target dev="tap73dee529-88"/>
Nov 08 21:38:52 user nova-compute[75993]:     </interface>
Nov 08 21:38:52 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:52 user nova-compute[75993]:       <mac address="fa:16:3e:c1:ec:aa"/>
Nov 08 21:38:52 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:52 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:52 user nova-compute[75993]:       <target dev="tap3824792e-3b"/>
Nov 08 21:38:52 user nova-compute[75993]:     </interface>
Nov 08 21:38:52 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:52 user nova-compute[75993]:       <mac address="fa:16:3e:88:3a:ca"/>
Nov 08 21:38:52 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:52 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:52 user nova-compute[75993]:       <target dev="tap6c5e3135-2e"/>
Nov 08 21:38:52 user nova-compute[75993]:     </interface>
Nov 08 21:38:52 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:38:52 user nova-compute[75993]:       <mac address="fa:16:3e:db:e8:3a"/>
Nov 08 21:38:52 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:52 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:38:52 user nova-compute[75993]:       <target dev="tapd412b0c6-d5"/>
Nov 08 21:38:52 user nova-compute[75993]:     </interface>
Nov 08 21:38:52 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:38:52 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/81c8325d-776c-4171-86eb-26f83b7dde00/console.log" append="off"/>
Nov 08 21:38:52 user nova-compute[75993]:     </serial>
Nov 08 21:38:52 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:38:52 user nova-compute[75993]:     <video>
Nov 08 21:38:52 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:38:52 user nova-compute[75993]:     </video>
Nov 08 21:38:52 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:38:52 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:38:52 user nova-compute[75993]:     </rng>
Nov 08 21:38:52 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:38:52 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:38:52 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:38:52 user nova-compute[75993]:     </memballoon>
Nov 08 21:38:52 user nova-compute[75993]:   </devices>
Nov 08 21:38:52 user nova-compute[75993]: </domain>
Nov 08 21:38:52 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=be74d5f7-6805-471f-8295-c60479f28e95,network=Network(629177fb-a069-4ada-a59d-705ad78c6943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe74d5f7-68') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=be74d5f7-6805-471f-8295-c60479f28e95,network=Network(629177fb-a069-4ada-a59d-705ad78c6943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe74d5f7-68') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af1ff693-d38d-55ac-95aa-f95235378bf3', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe74d5f7-68, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbe74d5f7-68, col_values=(('qos', UUID('ad77e68b-6f2c-47ba-8fd9-5c9175a2c672')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbe74d5f7-68, col_values=(('external_ids', {'iface-id': 'be74d5f7-6805-471f-8295-c60479f28e95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:ef:71', 'vm-uuid': '81c8325d-776c-4171-86eb-26f83b7dde00'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: INFO os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=be74d5f7-6805-471f-8295-c60479f28e95,network=Network(629177fb-a069-4ada-a59d-705ad78c6943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe74d5f7-68')
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:af:28,bridge_name='br-int',has_traffic_filtering=True,id=973638d8-8c22-4d53-9354-277bb212f9a0,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap973638d8-8c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:af:28,bridge_name='br-int',has_traffic_filtering=True,id=973638d8-8c22-4d53-9354-277bb212f9a0,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap973638d8-8c') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '554ae5c6-94fc-57d2-8063-bd47e09d61da', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap973638d8-8c, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap973638d8-8c, col_values=(('qos', UUID('69f52b4c-992b-4f4d-b541-d2894cf750ea')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap973638d8-8c, col_values=(('external_ids', {'iface-id': '973638d8-8c22-4d53-9354-277bb212f9a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:af:28', 'vm-uuid': '81c8325d-776c-4171-86eb-26f83b7dde00'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: INFO os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:af:28,bridge_name='br-int',has_traffic_filtering=True,id=973638d8-8c22-4d53-9354-277bb212f9a0,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap973638d8-8c')
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=65d1813e-7468-4b8f-b601-919421486512,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65d1813e-74') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=65d1813e-7468-4b8f-b601-919421486512,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65d1813e-74') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b36efc60-3419-5e3f-b59e-305ce2510949', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65d1813e-74, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65d1813e-74, col_values=(('qos', UUID('29752c8c-dc7a-4a75-8071-19518a213a79')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65d1813e-74, col_values=(('external_ids', {'iface-id': '65d1813e-7468-4b8f-b601-919421486512', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:ef:8b', 'vm-uuid': '81c8325d-776c-4171-86eb-26f83b7dde00'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: INFO os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=65d1813e-7468-4b8f-b601-919421486512,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65d1813e-74')
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4f:48,bridge_name='br-int',has_traffic_filtering=True,id=73dee529-8844-464d-8f84-9f9abd1f77b3,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dee529-88') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4f:48,bridge_name='br-int',has_traffic_filtering=True,id=73dee529-8844-464d-8f84-9f9abd1f77b3,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dee529-88') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3ae607aa-4bff-5efd-9ef5-66c26808055f', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73dee529-88, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73dee529-88, col_values=(('qos', UUID('d580c252-c3e5-445a-aa51-63e07d54e9f4')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73dee529-88, col_values=(('external_ids', {'iface-id': '73dee529-8844-464d-8f84-9f9abd1f77b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:4f:48', 'vm-uuid': '81c8325d-776c-4171-86eb-26f83b7dde00'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: INFO os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4f:48,bridge_name='br-int',has_traffic_filtering=True,id=73dee529-8844-464d-8f84-9f9abd1f77b3,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dee529-88')
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ec:aa,bridge_name='br-int',has_traffic_filtering=True,id=3824792e-3b3f-42e8-88de-ea963abd8625,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3824792e-3b') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ec:aa,bridge_name='br-int',has_traffic_filtering=True,id=3824792e-3b3f-42e8-88de-ea963abd8625,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3824792e-3b') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6cc64295-52a3-5c25-9d89-8d27fe2d531d', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3824792e-3b, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3824792e-3b, col_values=(('qos', UUID('53356ba8-6dae-4cea-bb83-9dd37c0a1af2')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3824792e-3b, col_values=(('external_ids', {'iface-id': '3824792e-3b3f-42e8-88de-ea963abd8625', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:ec:aa', 'vm-uuid': '81c8325d-776c-4171-86eb-26f83b7dde00'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "f0d20870-4544-428f-8963-4e358845514c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_brick.utils [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc356da-6467-4bc7-9e4f-e426a9b71740]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: INFO os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ec:aa,bridge_name='br-int',has_traffic_filtering=True,id=3824792e-3b3f-42e8-88de-ea963abd8625,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3824792e-3b')
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:3a:ca,bridge_name='br-int',has_traffic_filtering=True,id=6c5e3135-2e49-4589-8f5c-dd9c75622f91,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5e3135-2e') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:3a:ca,bridge_name='br-int',has_traffic_filtering=True,id=6c5e3135-2e49-4589-8f5c-dd9c75622f91,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5e3135-2e') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b64873e7-1fb5-521d-8e07-b44fc037cd68', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5a099e-0660-4462-9f19-200d4a6bfc20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[379623ff-f069-43ca-8508-d8332f7d651d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[594dfba0-f406-4855-bf8c-6eaeaa9a41bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:38:53 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[db18c285-fe2f-4b13-b71d-c0e9d57bc781]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_brick.utils [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c5e3135-2e, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c5e3135-2e, col_values=(('qos', UUID('aa65696c-61cc-4907-adec-a52f8bb0e70a')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c5e3135-2e, col_values=(('external_ids', {'iface-id': '6c5e3135-2e49-4589-8f5c-dd9c75622f91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:3a:ca', 'vm-uuid': '81c8325d-776c-4171-86eb-26f83b7dde00'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: INFO os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:3a:ca,bridge_name='br-int',has_traffic_filtering=True,id=6c5e3135-2e49-4589-8f5c-dd9c75622f91,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5e3135-2e')
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:36:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:e8:3a,bridge_name='br-int',has_traffic_filtering=True,id=d412b0c6-d5b0-4227-a40b-c6747d39448b,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd412b0c6-d5') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e8:3a,bridge_name='br-int',has_traffic_filtering=True,id=d412b0c6-d5b0-4227-a40b-c6747d39448b,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd412b0c6-d5') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b3c7e1b8-7c78-573c-a256-830cb5a1e235', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:54 user nova-compute[75993]: INFO nova.compute.manager [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] Swapping volume bf0a422a-57f7-4f07-a32f-6d6a4845ba7b for 88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:38:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd412b0c6-d5, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd412b0c6-d5, col_values=(('qos', UUID('0b9d8164-0f78-44c8-af99-e3a1b58ffb3c')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd412b0c6-d5, col_values=(('external_ids', {'iface-id': 'd412b0c6-d5b0-4227-a40b-c6747d39448b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:e8:3a', 'vm-uuid': '81c8325d-776c-4171-86eb-26f83b7dde00'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:54 user nova-compute[75993]: INFO os_vif [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e8:3a,bridge_name='br-int',has_traffic_filtering=True,id=d412b0c6-d5b0-4227-a40b-c6747d39448b,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd412b0c6-d5')
Nov 08 21:38:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5f80cff9-23b7-461a-82e5-81c73342e6be tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] No BDM found with device name hda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] No VIF found with MAC fa:16:3e:1a:ef:71, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] No VIF found with MAC fa:16:3e:c1:ec:aa, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:38:54 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Using config drive
Nov 08 21:38:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:54 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Creating config drive at /opt/stack/data/nova/instances/81c8325d-776c-4171-86eb-26f83b7dde00/disk.config
Nov 08 21:38:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/81c8325d-776c-4171-86eb-26f83b7dde00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdnpg239o {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/81c8325d-776c-4171-86eb-26f83b7dde00/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpdnpg239o" returned: 0 in 0.074s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:38:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.rescue --force-share --output=json" returned: 0 in 0.287s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.306s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-7818731c-99c0-46b1-aa26-761b883aa338 req-3f81cc4d-a75a-4d50-a823-3b9757074a39 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7818731c-99c0-46b1-aa26-761b883aa338 req-3f81cc4d-a75a-4d50-a823-3b9757074a39 service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7818731c-99c0-46b1-aa26-761b883aa338 req-3f81cc4d-a75a-4d50-a823-3b9757074a39 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7818731c-99c0-46b1-aa26-761b883aa338 req-3f81cc4d-a75a-4d50-a823-3b9757074a39 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-7818731c-99c0-46b1-aa26-761b883aa338 req-3f81cc4d-a75a-4d50-a823-3b9757074a39 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:38:57 user nova-compute[75993]: WARNING nova.compute.manager [req-7818731c-99c0-46b1-aa26-761b883aa338 req-3f81cc4d-a75a-4d50-a823-3b9757074a39 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-be74d5f7-6805-471f-8295-c60479f28e95 for instance with vm_state building and task_state spawning.
Nov 08 21:38:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.277s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:38:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:38:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:38:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-b0bf0a03-10ed-4132-9b40-cde6a0229dad req-610428bd-3b13-4f0c-b6c8-554f0fbab000 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-65d1813e-7468-4b8f-b601-919421486512 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b0bf0a03-10ed-4132-9b40-cde6a0229dad req-610428bd-3b13-4f0c-b6c8-554f0fbab000 service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b0bf0a03-10ed-4132-9b40-cde6a0229dad req-610428bd-3b13-4f0c-b6c8-554f0fbab000 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b0bf0a03-10ed-4132-9b40-cde6a0229dad req-610428bd-3b13-4f0c-b6c8-554f0fbab000 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-b0bf0a03-10ed-4132-9b40-cde6a0229dad req-610428bd-3b13-4f0c-b6c8-554f0fbab000 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-65d1813e-7468-4b8f-b601-919421486512 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-b0bf0a03-10ed-4132-9b40-cde6a0229dad req-610428bd-3b13-4f0c-b6c8-554f0fbab000 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-65d1813e-7468-4b8f-b601-919421486512 for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-be74d5f7-6805-471f-8295-c60479f28e95 for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-973638d8-8c22-4d53-9354-277bb212f9a0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-973638d8-8c22-4d53-9354-277bb212f9a0 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-973638d8-8c22-4d53-9354-277bb212f9a0 for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-973638d8-8c22-4d53-9354-277bb212f9a0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-973638d8-8c22-4d53-9354-277bb212f9a0 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-973638d8-8c22-4d53-9354-277bb212f9a0 for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-73dee529-8844-464d-8f84-9f9abd1f77b3 for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-5d45b886-d856-4e05-b74f-68e6ffd6d9d2 req-d161ca87-5306-4e9d-a2cc-4970eb69e25c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-73dee529-8844-464d-8f84-9f9abd1f77b3 for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-65d1813e-7468-4b8f-b601-919421486512 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-65d1813e-7468-4b8f-b601-919421486512 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-65d1813e-7468-4b8f-b601-919421486512 for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-3824792e-3b3f-42e8-88de-ea963abd8625 for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-6691afc5-6a22-48d0-a7ff-0432eb5f190c req-1afc516c-00b2-4e38-a89e-80f9c4c4facf service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-3824792e-3b3f-42e8-88de-ea963abd8625 for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-d412b0c6-d5b0-4227-a40b-c6747d39448b for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.compute.manager [req-f5ed5d5a-4924-4087-997d-d68072223e2b req-4d76ef01-ab15-40f9-a62d-1018cf243252 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-d412b0c6-d5b0-4227-a40b-c6747d39448b for instance with vm_state building and task_state spawning.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:39:02 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7851MB free_disk=25.511402130126953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:02 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Instance spawned successfully.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:02 user nova-compute[75993]: INFO nova.compute.manager [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Took 15.26 seconds to spawn the instance on the hypervisor.
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 35ca9fea-481a-42ac-8558-c5140e71de59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f0d20870-4544-428f-8963-4e358845514c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance c68ac7dc-3b4f-4d34-946d-86e8726c38af actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1a014eaf-7813-445b-b783-282ea30f034c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1299c29d-4c41-43c5-ad63-7eae393065d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9bb5a995-4872-4671-91ab-ca0127d65181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 81c8325d-776c-4171-86eb-26f83b7dde00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:39:03 user nova-compute[75993]: INFO nova.compute.manager [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Took 181.36 seconds to build instance.
Nov 08 21:39:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b2cc5913-ec74-4804-b457-16faf5e4d662 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "81c8325d-776c-4171-86eb-26f83b7dde00" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 181.483s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.626s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:03 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Waiting for libvirt event about the detach of device tap21e2ed5b-c9 with device alias net1 from instance c68ac7dc-3b4f-4d34-946d-86e8726c38af is timed out.
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b7:2f:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tap21e2ed5b-c9"/></interface> {{(pid=75993) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b7:2f:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tap21e2ed5b-c9"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 21:39:03 user nova-compute[75993]:   <name>instance-00000007</name>
Nov 08 21:39:03 user nova-compute[75993]:   <uuid>c68ac7dc-3b4f-4d34-946d-86e8726c38af</uuid>
Nov 08 21:39:03 user nova-compute[75993]:   <metadata>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:39:03 user nova-compute[75993]:   <nova:package version="0.0.0"/>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:name>tempest-device-tagging-server-686990095</nova:name>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:creationTime>2023-11-08 21:36:26</nova:creationTime>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:flavor name="m1.tiny">
Nov 08 21:39:03 user nova-compute[75993]:     <nova:memory>512</nova:memory>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:disk>1</nova:disk>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:swap>0</nova:swap>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:vcpus>1</nova:vcpus>
Nov 08 21:39:03 user nova-compute[75993]:   </nova:flavor>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:owner>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:user uuid="6b13e1fc5636403f88aee213e6d70e7d">tempest-TaggedAttachmentsTest-1487427237-project-member</nova:user>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:project uuid="3144772c95b74eecbd2a1781114cfb77">tempest-TaggedAttachmentsTest-1487427237</nova:project>
Nov 08 21:39:03 user nova-compute[75993]:   </nova:owner>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:ports>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:port uuid="d05110a2-8c3f-492e-8f02-77d7e07983cb">
Nov 08 21:39:03 user nova-compute[75993]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 21:39:03 user nova-compute[75993]:     </nova:port>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:port uuid="21e2ed5b-c9b3-42f2-b19b-26fdb450de38">
Nov 08 21:39:03 user nova-compute[75993]:       <nova:ip type="fixed" address="10.10.10.128" ipVersion="4"/>
Nov 08 21:39:03 user nova-compute[75993]:     </nova:port>
Nov 08 21:39:03 user nova-compute[75993]:   </nova:ports>
Nov 08 21:39:03 user nova-compute[75993]: </nova:instance>
Nov 08 21:39:03 user nova-compute[75993]:   </metadata>
Nov 08 21:39:03 user nova-compute[75993]:   <memory unit='KiB'>524288</memory>
Nov 08 21:39:03 user nova-compute[75993]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 21:39:03 user nova-compute[75993]:   <vcpu placement='static'>1</vcpu>
Nov 08 21:39:03 user nova-compute[75993]:   <resource>
Nov 08 21:39:03 user nova-compute[75993]:     <partition>/machine</partition>
Nov 08 21:39:03 user nova-compute[75993]:   </resource>
Nov 08 21:39:03 user nova-compute[75993]:   <sysinfo type='smbios'>
Nov 08 21:39:03 user nova-compute[75993]:     <system>
Nov 08 21:39:03 user nova-compute[75993]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 21:39:03 user nova-compute[75993]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 21:39:03 user nova-compute[75993]:       <entry name='version'>0.0.0</entry>
Nov 08 21:39:03 user nova-compute[75993]:       <entry name='serial'>c68ac7dc-3b4f-4d34-946d-86e8726c38af</entry>
Nov 08 21:39:03 user nova-compute[75993]:       <entry name='uuid'>c68ac7dc-3b4f-4d34-946d-86e8726c38af</entry>
Nov 08 21:39:03 user nova-compute[75993]:       <entry name='family'>Virtual Machine</entry>
Nov 08 21:39:03 user nova-compute[75993]:     </system>
Nov 08 21:39:03 user nova-compute[75993]:   </sysinfo>
Nov 08 21:39:03 user nova-compute[75993]:   <os>
Nov 08 21:39:03 user nova-compute[75993]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 21:39:03 user nova-compute[75993]:     <boot dev='hd'/>
Nov 08 21:39:03 user nova-compute[75993]:     <smbios mode='sysinfo'/>
Nov 08 21:39:03 user nova-compute[75993]:   </os>
Nov 08 21:39:03 user nova-compute[75993]:   <features>
Nov 08 21:39:03 user nova-compute[75993]:     <acpi/>
Nov 08 21:39:03 user nova-compute[75993]:     <apic/>
Nov 08 21:39:03 user nova-compute[75993]:     <vmcoreinfo state='on'/>
Nov 08 21:39:03 user nova-compute[75993]:   </features>
Nov 08 21:39:03 user nova-compute[75993]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 21:39:03 user nova-compute[75993]:     <model fallback='forbid'>Nehalem</model>
Nov 08 21:39:03 user nova-compute[75993]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 21:39:03 user nova-compute[75993]:     <feature policy='require' name='vme'/>
Nov 08 21:39:03 user nova-compute[75993]:     <feature policy='require' name='x2apic'/>
Nov 08 21:39:03 user nova-compute[75993]:     <feature policy='require' name='hypervisor'/>
Nov 08 21:39:03 user nova-compute[75993]:   </cpu>
Nov 08 21:39:03 user nova-compute[75993]:   <clock offset='utc'>
Nov 08 21:39:03 user nova-compute[75993]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 21:39:03 user nova-compute[75993]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 21:39:03 user nova-compute[75993]:     <timer name='hpet' present='no'/>
Nov 08 21:39:03 user nova-compute[75993]:   </clock>
Nov 08 21:39:03 user nova-compute[75993]:   <on_poweroff>destroy</on_poweroff>
Nov 08 21:39:03 user nova-compute[75993]:   <on_reboot>restart</on_reboot>
Nov 08 21:39:03 user nova-compute[75993]:   <on_crash>destroy</on_crash>
Nov 08 21:39:03 user nova-compute[75993]:   <devices>
Nov 08 21:39:03 user nova-compute[75993]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 21:39:03 user nova-compute[75993]:     <disk type='file' device='disk'>
Nov 08 21:39:03 user nova-compute[75993]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 21:39:03 user nova-compute[75993]:       <source file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk' index='2'/>
Nov 08 21:39:03 user nova-compute[75993]:       <backingStore type='file' index='3'>
Nov 08 21:39:03 user nova-compute[75993]:         <format type='raw'/>
Nov 08 21:39:03 user nova-compute[75993]:         <source file='/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be'/>
Nov 08 21:39:03 user nova-compute[75993]:         <backingStore/>
Nov 08 21:39:03 user nova-compute[75993]:       </backingStore>
Nov 08 21:39:03 user nova-compute[75993]:       <target dev='vda' bus='virtio'/>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='virtio-disk0'/>
Nov 08 21:39:03 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 21:39:03 user nova-compute[75993]:     </disk>
Nov 08 21:39:03 user nova-compute[75993]:     <disk type='file' device='cdrom'>
Nov 08 21:39:03 user nova-compute[75993]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 21:39:03 user nova-compute[75993]:       <source file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk.config' index='1'/>
Nov 08 21:39:03 user nova-compute[75993]:       <backingStore/>
Nov 08 21:39:03 user nova-compute[75993]:       <target dev='hda' bus='ide'/>
Nov 08 21:39:03 user nova-compute[75993]:       <readonly/>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='ide0-0-0'/>
Nov 08 21:39:03 user nova-compute[75993]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 21:39:03 user nova-compute[75993]:     </disk>
Nov 08 21:39:03 user nova-compute[75993]:     <controller type='usb' index='0' model='none'>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='usb'/>
Nov 08 21:39:03 user nova-compute[75993]:     </controller>
Nov 08 21:39:03 user nova-compute[75993]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='pci.0'/>
Nov 08 21:39:03 user nova-compute[75993]:     </controller>
Nov 08 21:39:03 user nova-compute[75993]:     <controller type='ide' index='0'>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='ide'/>
Nov 08 21:39:03 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 21:39:03 user nova-compute[75993]:     </controller>
Nov 08 21:39:03 user nova-compute[75993]:     <interface type='ethernet'>
Nov 08 21:39:03 user nova-compute[75993]:       <mac address='fa:16:3e:61:e1:be'/>
Nov 08 21:39:03 user nova-compute[75993]:       <target dev='tapd05110a2-8c'/>
Nov 08 21:39:03 user nova-compute[75993]:       <model type='virtio'/>
Nov 08 21:39:03 user nova-compute[75993]:       <mtu size='1442'/>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='net0'/>
Nov 08 21:39:03 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 21:39:03 user nova-compute[75993]:     </interface>
Nov 08 21:39:03 user nova-compute[75993]:     <serial type='pty'>
Nov 08 21:39:03 user nova-compute[75993]:       <source path='/dev/pts/6'/>
Nov 08 21:39:03 user nova-compute[75993]:       <log file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/console.log' append='off'/>
Nov 08 21:39:03 user nova-compute[75993]:       <target type='isa-serial' port='0'>
Nov 08 21:39:03 user nova-compute[75993]:         <model name='isa-serial'/>
Nov 08 21:39:03 user nova-compute[75993]:       </target>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='serial0'/>
Nov 08 21:39:03 user nova-compute[75993]:     </serial>
Nov 08 21:39:03 user nova-compute[75993]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 21:39:03 user nova-compute[75993]:       <source path='/dev/pts/6'/>
Nov 08 21:39:03 user nova-compute[75993]:       <log file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/console.log' append='off'/>
Nov 08 21:39:03 user nova-compute[75993]:       <target type='serial' port='0'/>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='serial0'/>
Nov 08 21:39:03 user nova-compute[75993]:     </console>
Nov 08 21:39:03 user nova-compute[75993]:     <input type='mouse' bus='ps2'>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='input0'/>
Nov 08 21:39:03 user nova-compute[75993]:     </input>
Nov 08 21:39:03 user nova-compute[75993]:     <input type='keyboard' bus='ps2'>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='input1'/>
Nov 08 21:39:03 user nova-compute[75993]:     </input>
Nov 08 21:39:03 user nova-compute[75993]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 21:39:03 user nova-compute[75993]:       <listen type='address' address='0.0.0.0'/>
Nov 08 21:39:03 user nova-compute[75993]:     </graphics>
Nov 08 21:39:03 user nova-compute[75993]:     <audio id='1' type='none'/>
Nov 08 21:39:03 user nova-compute[75993]:     <video>
Nov 08 21:39:03 user nova-compute[75993]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='video0'/>
Nov 08 21:39:03 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 21:39:03 user nova-compute[75993]:     </video>
Nov 08 21:39:03 user nova-compute[75993]:     <memballoon model='virtio'>
Nov 08 21:39:03 user nova-compute[75993]:       <stats period='10'/>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='balloon0'/>
Nov 08 21:39:03 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 21:39:03 user nova-compute[75993]:     </memballoon>
Nov 08 21:39:03 user nova-compute[75993]:     <rng model='virtio'>
Nov 08 21:39:03 user nova-compute[75993]:       <backend model='random'>/dev/urandom</backend>
Nov 08 21:39:03 user nova-compute[75993]:       <alias name='rng0'/>
Nov 08 21:39:03 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 21:39:03 user nova-compute[75993]:     </rng>
Nov 08 21:39:03 user nova-compute[75993]:   </devices>
Nov 08 21:39:03 user nova-compute[75993]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 21:39:03 user nova-compute[75993]:     <label>libvirt-c68ac7dc-3b4f-4d34-946d-86e8726c38af</label>
Nov 08 21:39:03 user nova-compute[75993]:     <imagelabel>libvirt-c68ac7dc-3b4f-4d34-946d-86e8726c38af</imagelabel>
Nov 08 21:39:03 user nova-compute[75993]:   </seclabel>
Nov 08 21:39:03 user nova-compute[75993]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 21:39:03 user nova-compute[75993]:     <label>+64055:+108</label>
Nov 08 21:39:03 user nova-compute[75993]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 21:39:03 user nova-compute[75993]:   </seclabel>
Nov 08 21:39:03 user nova-compute[75993]: </domain>
Nov 08 21:39:03 user nova-compute[75993]:  {{(pid=75993) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 21:39:03 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Successfully detached device tap21e2ed5b-c9 from instance c68ac7dc-3b4f-4d34-946d-86e8726c38af from the live domain config.
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686990095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686990095',id=7,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIYNlWsNYNXIPzYxHJHsqWLqulGXulk0Teiy9wHphwJUB1UKtAxuCAT9/nMP58cJKIagHsE3mNVjHBFc2GKI4Bsmrn42N0sgHxg9hFcGJDRyLkXho/6LRS6t4SoMazlhg==',key_name='tempest-keypair-1407039979',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3144772c95b74eecbd2a1781114cfb77',ramdisk_id='',reservation_id='r-5deny31q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487427237',owner_user_name='tempest-TaggedAttachmentsTest-1487427237-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b13e1fc5636403f88aee213e6d70e7d',uuid=c68ac7dc-3b4f-4d34-946d-86e8726c38af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converting VIF {"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG os_vif [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21e2ed5b-c9, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c93d268-1fbd-4c87-957d-9d50487a0361) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:03 user nova-compute[75993]: INFO os_vif [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9')
Nov 08 21:39:03 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:39:03 user nova-compute[75993]:   <nova:package version="0.0.0"/>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:name>tempest-device-tagging-server-686990095</nova:name>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:creationTime>2023-11-08 21:39:03</nova:creationTime>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:flavor name="m1.tiny">
Nov 08 21:39:03 user nova-compute[75993]:     <nova:memory>512</nova:memory>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:disk>1</nova:disk>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:swap>0</nova:swap>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:vcpus>1</nova:vcpus>
Nov 08 21:39:03 user nova-compute[75993]:   </nova:flavor>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:owner>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:user uuid="6b13e1fc5636403f88aee213e6d70e7d">tempest-TaggedAttachmentsTest-1487427237-project-member</nova:user>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:project uuid="3144772c95b74eecbd2a1781114cfb77">tempest-TaggedAttachmentsTest-1487427237</nova:project>
Nov 08 21:39:03 user nova-compute[75993]:   </nova:owner>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:39:03 user nova-compute[75993]:   <nova:ports>
Nov 08 21:39:03 user nova-compute[75993]:     <nova:port uuid="d05110a2-8c3f-492e-8f02-77d7e07983cb">
Nov 08 21:39:03 user nova-compute[75993]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 21:39:03 user nova-compute[75993]:     </nova:port>
Nov 08 21:39:03 user nova-compute[75993]:   </nova:ports>
Nov 08 21:39:03 user nova-compute[75993]: </nova:instance>
Nov 08 21:39:03 user nova-compute[75993]:  {{(pid=75993) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 21:39:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:39:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:39:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquired lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:39:04 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:39:04 user nova-compute[75993]: DEBUG nova.compute.manager [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-vif-deleted-21e2ed5b-c9b3-42f2-b19b-26fdb450de38 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:04 user nova-compute[75993]: INFO nova.compute.manager [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Neutron deleted interface 21e2ed5b-c9b3-42f2-b19b-26fdb450de38; detaching it from the instance and deleting it from the info cache
Nov 08 21:39:04 user nova-compute[75993]: DEBUG nova.network.neutron [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updating instance_info_cache with network_info: [{"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.objects.instance [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] Lazy-loading 'system_metadata' on Instance uuid c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.objects.instance [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] Lazy-loading 'flavor' on Instance uuid c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.objects.base [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] Object Instance<c68ac7dc-3b4f-4d34-946d-86e8726c38af> lazy-loaded attributes: system_metadata,flavor {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686990095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686990095',id=7,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIYNlWsNYNXIPzYxHJHsqWLqulGXulk0Teiy9wHphwJUB1UKtAxuCAT9/nMP58cJKIagHsE3mNVjHBFc2GKI4Bsmrn42N0sgHxg9hFcGJDRyLkXho/6LRS6t4SoMazlhg==',key_name='tempest-keypair-1407039979',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3144772c95b74eecbd2a1781114cfb77',ramdisk_id='',reservation_id='r-5deny31q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487427237',owner_user_name='tempest-TaggedAttachmentsTest-1487427237-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b13e1fc5636403f88aee213e6d70e7d',uuid=c68ac7dc-3b4f-4d34-946d-86e8726c38af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] Converting VIF {"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b7:2f:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tap21e2ed5b-c9"/></interface> {{(pid=75993) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b7:2f:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tap21e2ed5b-c9"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 21:39:05 user nova-compute[75993]:   <name>instance-00000007</name>
Nov 08 21:39:05 user nova-compute[75993]:   <uuid>c68ac7dc-3b4f-4d34-946d-86e8726c38af</uuid>
Nov 08 21:39:05 user nova-compute[75993]:   <metadata>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:39:05 user nova-compute[75993]:   <nova:package version="0.0.0"/>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:name>tempest-device-tagging-server-686990095</nova:name>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:creationTime>2023-11-08 21:39:03</nova:creationTime>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:flavor name="m1.tiny">
Nov 08 21:39:05 user nova-compute[75993]:     <nova:memory>512</nova:memory>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:disk>1</nova:disk>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:swap>0</nova:swap>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:vcpus>1</nova:vcpus>
Nov 08 21:39:05 user nova-compute[75993]:   </nova:flavor>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:owner>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:user uuid="6b13e1fc5636403f88aee213e6d70e7d">tempest-TaggedAttachmentsTest-1487427237-project-member</nova:user>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:project uuid="3144772c95b74eecbd2a1781114cfb77">tempest-TaggedAttachmentsTest-1487427237</nova:project>
Nov 08 21:39:05 user nova-compute[75993]:   </nova:owner>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:ports>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:port uuid="d05110a2-8c3f-492e-8f02-77d7e07983cb">
Nov 08 21:39:05 user nova-compute[75993]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 21:39:05 user nova-compute[75993]:     </nova:port>
Nov 08 21:39:05 user nova-compute[75993]:   </nova:ports>
Nov 08 21:39:05 user nova-compute[75993]: </nova:instance>
Nov 08 21:39:05 user nova-compute[75993]:   </metadata>
Nov 08 21:39:05 user nova-compute[75993]:   <memory unit='KiB'>524288</memory>
Nov 08 21:39:05 user nova-compute[75993]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 21:39:05 user nova-compute[75993]:   <vcpu placement='static'>1</vcpu>
Nov 08 21:39:05 user nova-compute[75993]:   <resource>
Nov 08 21:39:05 user nova-compute[75993]:     <partition>/machine</partition>
Nov 08 21:39:05 user nova-compute[75993]:   </resource>
Nov 08 21:39:05 user nova-compute[75993]:   <sysinfo type='smbios'>
Nov 08 21:39:05 user nova-compute[75993]:     <system>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='version'>0.0.0</entry>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='serial'>c68ac7dc-3b4f-4d34-946d-86e8726c38af</entry>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='uuid'>c68ac7dc-3b4f-4d34-946d-86e8726c38af</entry>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='family'>Virtual Machine</entry>
Nov 08 21:39:05 user nova-compute[75993]:     </system>
Nov 08 21:39:05 user nova-compute[75993]:   </sysinfo>
Nov 08 21:39:05 user nova-compute[75993]:   <os>
Nov 08 21:39:05 user nova-compute[75993]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 21:39:05 user nova-compute[75993]:     <boot dev='hd'/>
Nov 08 21:39:05 user nova-compute[75993]:     <smbios mode='sysinfo'/>
Nov 08 21:39:05 user nova-compute[75993]:   </os>
Nov 08 21:39:05 user nova-compute[75993]:   <features>
Nov 08 21:39:05 user nova-compute[75993]:     <acpi/>
Nov 08 21:39:05 user nova-compute[75993]:     <apic/>
Nov 08 21:39:05 user nova-compute[75993]:     <vmcoreinfo state='on'/>
Nov 08 21:39:05 user nova-compute[75993]:   </features>
Nov 08 21:39:05 user nova-compute[75993]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 21:39:05 user nova-compute[75993]:     <model fallback='forbid'>Nehalem</model>
Nov 08 21:39:05 user nova-compute[75993]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 21:39:05 user nova-compute[75993]:     <feature policy='require' name='vme'/>
Nov 08 21:39:05 user nova-compute[75993]:     <feature policy='require' name='x2apic'/>
Nov 08 21:39:05 user nova-compute[75993]:     <feature policy='require' name='hypervisor'/>
Nov 08 21:39:05 user nova-compute[75993]:   </cpu>
Nov 08 21:39:05 user nova-compute[75993]:   <clock offset='utc'>
Nov 08 21:39:05 user nova-compute[75993]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 21:39:05 user nova-compute[75993]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 21:39:05 user nova-compute[75993]:     <timer name='hpet' present='no'/>
Nov 08 21:39:05 user nova-compute[75993]:   </clock>
Nov 08 21:39:05 user nova-compute[75993]:   <on_poweroff>destroy</on_poweroff>
Nov 08 21:39:05 user nova-compute[75993]:   <on_reboot>restart</on_reboot>
Nov 08 21:39:05 user nova-compute[75993]:   <on_crash>destroy</on_crash>
Nov 08 21:39:05 user nova-compute[75993]:   <devices>
Nov 08 21:39:05 user nova-compute[75993]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 21:39:05 user nova-compute[75993]:     <disk type='file' device='disk'>
Nov 08 21:39:05 user nova-compute[75993]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 21:39:05 user nova-compute[75993]:       <source file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk' index='2'/>
Nov 08 21:39:05 user nova-compute[75993]:       <backingStore type='file' index='3'>
Nov 08 21:39:05 user nova-compute[75993]:         <format type='raw'/>
Nov 08 21:39:05 user nova-compute[75993]:         <source file='/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be'/>
Nov 08 21:39:05 user nova-compute[75993]:         <backingStore/>
Nov 08 21:39:05 user nova-compute[75993]:       </backingStore>
Nov 08 21:39:05 user nova-compute[75993]:       <target dev='vda' bus='virtio'/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='virtio-disk0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </disk>
Nov 08 21:39:05 user nova-compute[75993]:     <disk type='file' device='cdrom'>
Nov 08 21:39:05 user nova-compute[75993]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 21:39:05 user nova-compute[75993]:       <source file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk.config' index='1'/>
Nov 08 21:39:05 user nova-compute[75993]:       <backingStore/>
Nov 08 21:39:05 user nova-compute[75993]:       <target dev='hda' bus='ide'/>
Nov 08 21:39:05 user nova-compute[75993]:       <readonly/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='ide0-0-0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </disk>
Nov 08 21:39:05 user nova-compute[75993]:     <controller type='usb' index='0' model='none'>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='usb'/>
Nov 08 21:39:05 user nova-compute[75993]:     </controller>
Nov 08 21:39:05 user nova-compute[75993]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='pci.0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </controller>
Nov 08 21:39:05 user nova-compute[75993]:     <controller type='ide' index='0'>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='ide'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 21:39:05 user nova-compute[75993]:     </controller>
Nov 08 21:39:05 user nova-compute[75993]:     <interface type='ethernet'>
Nov 08 21:39:05 user nova-compute[75993]:       <mac address='fa:16:3e:61:e1:be'/>
Nov 08 21:39:05 user nova-compute[75993]:       <target dev='tapd05110a2-8c'/>
Nov 08 21:39:05 user nova-compute[75993]:       <model type='virtio'/>
Nov 08 21:39:05 user nova-compute[75993]:       <mtu size='1442'/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='net0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </interface>
Nov 08 21:39:05 user nova-compute[75993]:     <serial type='pty'>
Nov 08 21:39:05 user nova-compute[75993]:       <source path='/dev/pts/6'/>
Nov 08 21:39:05 user nova-compute[75993]:       <log file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/console.log' append='off'/>
Nov 08 21:39:05 user nova-compute[75993]:       <target type='isa-serial' port='0'>
Nov 08 21:39:05 user nova-compute[75993]:         <model name='isa-serial'/>
Nov 08 21:39:05 user nova-compute[75993]:       </target>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='serial0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </serial>
Nov 08 21:39:05 user nova-compute[75993]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 21:39:05 user nova-compute[75993]:       <source path='/dev/pts/6'/>
Nov 08 21:39:05 user nova-compute[75993]:       <log file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/console.log' append='off'/>
Nov 08 21:39:05 user nova-compute[75993]:       <target type='serial' port='0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='serial0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </console>
Nov 08 21:39:05 user nova-compute[75993]:     <input type='mouse' bus='ps2'>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='input0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </input>
Nov 08 21:39:05 user nova-compute[75993]:     <input type='keyboard' bus='ps2'>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='input1'/>
Nov 08 21:39:05 user nova-compute[75993]:     </input>
Nov 08 21:39:05 user nova-compute[75993]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 21:39:05 user nova-compute[75993]:       <listen type='address' address='0.0.0.0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </graphics>
Nov 08 21:39:05 user nova-compute[75993]:     <audio id='1' type='none'/>
Nov 08 21:39:05 user nova-compute[75993]:     <video>
Nov 08 21:39:05 user nova-compute[75993]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='video0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </video>
Nov 08 21:39:05 user nova-compute[75993]:     <memballoon model='virtio'>
Nov 08 21:39:05 user nova-compute[75993]:       <stats period='10'/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='balloon0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </memballoon>
Nov 08 21:39:05 user nova-compute[75993]:     <rng model='virtio'>
Nov 08 21:39:05 user nova-compute[75993]:       <backend model='random'>/dev/urandom</backend>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='rng0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </rng>
Nov 08 21:39:05 user nova-compute[75993]:   </devices>
Nov 08 21:39:05 user nova-compute[75993]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 21:39:05 user nova-compute[75993]:     <label>libvirt-c68ac7dc-3b4f-4d34-946d-86e8726c38af</label>
Nov 08 21:39:05 user nova-compute[75993]:     <imagelabel>libvirt-c68ac7dc-3b4f-4d34-946d-86e8726c38af</imagelabel>
Nov 08 21:39:05 user nova-compute[75993]:   </seclabel>
Nov 08 21:39:05 user nova-compute[75993]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 21:39:05 user nova-compute[75993]:     <label>+64055:+108</label>
Nov 08 21:39:05 user nova-compute[75993]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 21:39:05 user nova-compute[75993]:   </seclabel>
Nov 08 21:39:05 user nova-compute[75993]: </domain>
Nov 08 21:39:05 user nova-compute[75993]:  {{(pid=75993) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:b7:2f:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tap21e2ed5b-c9"/></interface> {{(pid=75993) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:b7:2f:f0"/><model type="virtio"/><mtu size="1442"/><target dev="tap21e2ed5b-c9"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 08 21:39:05 user nova-compute[75993]:   <name>instance-00000007</name>
Nov 08 21:39:05 user nova-compute[75993]:   <uuid>c68ac7dc-3b4f-4d34-946d-86e8726c38af</uuid>
Nov 08 21:39:05 user nova-compute[75993]:   <metadata>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:39:05 user nova-compute[75993]:   <nova:package version="0.0.0"/>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:name>tempest-device-tagging-server-686990095</nova:name>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:creationTime>2023-11-08 21:39:03</nova:creationTime>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:flavor name="m1.tiny">
Nov 08 21:39:05 user nova-compute[75993]:     <nova:memory>512</nova:memory>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:disk>1</nova:disk>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:swap>0</nova:swap>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:vcpus>1</nova:vcpus>
Nov 08 21:39:05 user nova-compute[75993]:   </nova:flavor>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:owner>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:user uuid="6b13e1fc5636403f88aee213e6d70e7d">tempest-TaggedAttachmentsTest-1487427237-project-member</nova:user>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:project uuid="3144772c95b74eecbd2a1781114cfb77">tempest-TaggedAttachmentsTest-1487427237</nova:project>
Nov 08 21:39:05 user nova-compute[75993]:   </nova:owner>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:ports>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:port uuid="d05110a2-8c3f-492e-8f02-77d7e07983cb">
Nov 08 21:39:05 user nova-compute[75993]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 21:39:05 user nova-compute[75993]:     </nova:port>
Nov 08 21:39:05 user nova-compute[75993]:   </nova:ports>
Nov 08 21:39:05 user nova-compute[75993]: </nova:instance>
Nov 08 21:39:05 user nova-compute[75993]:   </metadata>
Nov 08 21:39:05 user nova-compute[75993]:   <memory unit='KiB'>524288</memory>
Nov 08 21:39:05 user nova-compute[75993]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 08 21:39:05 user nova-compute[75993]:   <vcpu placement='static'>1</vcpu>
Nov 08 21:39:05 user nova-compute[75993]:   <resource>
Nov 08 21:39:05 user nova-compute[75993]:     <partition>/machine</partition>
Nov 08 21:39:05 user nova-compute[75993]:   </resource>
Nov 08 21:39:05 user nova-compute[75993]:   <sysinfo type='smbios'>
Nov 08 21:39:05 user nova-compute[75993]:     <system>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='product'>OpenStack Nova</entry>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='version'>0.0.0</entry>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='serial'>c68ac7dc-3b4f-4d34-946d-86e8726c38af</entry>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='uuid'>c68ac7dc-3b4f-4d34-946d-86e8726c38af</entry>
Nov 08 21:39:05 user nova-compute[75993]:       <entry name='family'>Virtual Machine</entry>
Nov 08 21:39:05 user nova-compute[75993]:     </system>
Nov 08 21:39:05 user nova-compute[75993]:   </sysinfo>
Nov 08 21:39:05 user nova-compute[75993]:   <os>
Nov 08 21:39:05 user nova-compute[75993]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 08 21:39:05 user nova-compute[75993]:     <boot dev='hd'/>
Nov 08 21:39:05 user nova-compute[75993]:     <smbios mode='sysinfo'/>
Nov 08 21:39:05 user nova-compute[75993]:   </os>
Nov 08 21:39:05 user nova-compute[75993]:   <features>
Nov 08 21:39:05 user nova-compute[75993]:     <acpi/>
Nov 08 21:39:05 user nova-compute[75993]:     <apic/>
Nov 08 21:39:05 user nova-compute[75993]:     <vmcoreinfo state='on'/>
Nov 08 21:39:05 user nova-compute[75993]:   </features>
Nov 08 21:39:05 user nova-compute[75993]:   <cpu mode='custom' match='exact' check='full'>
Nov 08 21:39:05 user nova-compute[75993]:     <model fallback='forbid'>Nehalem</model>
Nov 08 21:39:05 user nova-compute[75993]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 08 21:39:05 user nova-compute[75993]:     <feature policy='require' name='vme'/>
Nov 08 21:39:05 user nova-compute[75993]:     <feature policy='require' name='x2apic'/>
Nov 08 21:39:05 user nova-compute[75993]:     <feature policy='require' name='hypervisor'/>
Nov 08 21:39:05 user nova-compute[75993]:   </cpu>
Nov 08 21:39:05 user nova-compute[75993]:   <clock offset='utc'>
Nov 08 21:39:05 user nova-compute[75993]:     <timer name='pit' tickpolicy='delay'/>
Nov 08 21:39:05 user nova-compute[75993]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 08 21:39:05 user nova-compute[75993]:     <timer name='hpet' present='no'/>
Nov 08 21:39:05 user nova-compute[75993]:   </clock>
Nov 08 21:39:05 user nova-compute[75993]:   <on_poweroff>destroy</on_poweroff>
Nov 08 21:39:05 user nova-compute[75993]:   <on_reboot>restart</on_reboot>
Nov 08 21:39:05 user nova-compute[75993]:   <on_crash>destroy</on_crash>
Nov 08 21:39:05 user nova-compute[75993]:   <devices>
Nov 08 21:39:05 user nova-compute[75993]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 08 21:39:05 user nova-compute[75993]:     <disk type='file' device='disk'>
Nov 08 21:39:05 user nova-compute[75993]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 08 21:39:05 user nova-compute[75993]:       <source file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk' index='2'/>
Nov 08 21:39:05 user nova-compute[75993]:       <backingStore type='file' index='3'>
Nov 08 21:39:05 user nova-compute[75993]:         <format type='raw'/>
Nov 08 21:39:05 user nova-compute[75993]:         <source file='/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be'/>
Nov 08 21:39:05 user nova-compute[75993]:         <backingStore/>
Nov 08 21:39:05 user nova-compute[75993]:       </backingStore>
Nov 08 21:39:05 user nova-compute[75993]:       <target dev='vda' bus='virtio'/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='virtio-disk0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </disk>
Nov 08 21:39:05 user nova-compute[75993]:     <disk type='file' device='cdrom'>
Nov 08 21:39:05 user nova-compute[75993]:       <driver name='qemu' type='raw' cache='none'/>
Nov 08 21:39:05 user nova-compute[75993]:       <source file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/disk.config' index='1'/>
Nov 08 21:39:05 user nova-compute[75993]:       <backingStore/>
Nov 08 21:39:05 user nova-compute[75993]:       <target dev='hda' bus='ide'/>
Nov 08 21:39:05 user nova-compute[75993]:       <readonly/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='ide0-0-0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </disk>
Nov 08 21:39:05 user nova-compute[75993]:     <controller type='usb' index='0' model='none'>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='usb'/>
Nov 08 21:39:05 user nova-compute[75993]:     </controller>
Nov 08 21:39:05 user nova-compute[75993]:     <controller type='pci' index='0' model='pci-root'>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='pci.0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </controller>
Nov 08 21:39:05 user nova-compute[75993]:     <controller type='ide' index='0'>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='ide'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 08 21:39:05 user nova-compute[75993]:     </controller>
Nov 08 21:39:05 user nova-compute[75993]:     <interface type='ethernet'>
Nov 08 21:39:05 user nova-compute[75993]:       <mac address='fa:16:3e:61:e1:be'/>
Nov 08 21:39:05 user nova-compute[75993]:       <target dev='tapd05110a2-8c'/>
Nov 08 21:39:05 user nova-compute[75993]:       <model type='virtio'/>
Nov 08 21:39:05 user nova-compute[75993]:       <mtu size='1442'/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='net0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </interface>
Nov 08 21:39:05 user nova-compute[75993]:     <serial type='pty'>
Nov 08 21:39:05 user nova-compute[75993]:       <source path='/dev/pts/6'/>
Nov 08 21:39:05 user nova-compute[75993]:       <log file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/console.log' append='off'/>
Nov 08 21:39:05 user nova-compute[75993]:       <target type='isa-serial' port='0'>
Nov 08 21:39:05 user nova-compute[75993]:         <model name='isa-serial'/>
Nov 08 21:39:05 user nova-compute[75993]:       </target>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='serial0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </serial>
Nov 08 21:39:05 user nova-compute[75993]:     <console type='pty' tty='/dev/pts/6'>
Nov 08 21:39:05 user nova-compute[75993]:       <source path='/dev/pts/6'/>
Nov 08 21:39:05 user nova-compute[75993]:       <log file='/opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af/console.log' append='off'/>
Nov 08 21:39:05 user nova-compute[75993]:       <target type='serial' port='0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='serial0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </console>
Nov 08 21:39:05 user nova-compute[75993]:     <input type='mouse' bus='ps2'>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='input0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </input>
Nov 08 21:39:05 user nova-compute[75993]:     <input type='keyboard' bus='ps2'>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='input1'/>
Nov 08 21:39:05 user nova-compute[75993]:     </input>
Nov 08 21:39:05 user nova-compute[75993]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 08 21:39:05 user nova-compute[75993]:       <listen type='address' address='0.0.0.0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </graphics>
Nov 08 21:39:05 user nova-compute[75993]:     <audio id='1' type='none'/>
Nov 08 21:39:05 user nova-compute[75993]:     <video>
Nov 08 21:39:05 user nova-compute[75993]:       <model type='virtio' heads='1' primary='yes'/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='video0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </video>
Nov 08 21:39:05 user nova-compute[75993]:     <memballoon model='virtio'>
Nov 08 21:39:05 user nova-compute[75993]:       <stats period='10'/>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='balloon0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </memballoon>
Nov 08 21:39:05 user nova-compute[75993]:     <rng model='virtio'>
Nov 08 21:39:05 user nova-compute[75993]:       <backend model='random'>/dev/urandom</backend>
Nov 08 21:39:05 user nova-compute[75993]:       <alias name='rng0'/>
Nov 08 21:39:05 user nova-compute[75993]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 08 21:39:05 user nova-compute[75993]:     </rng>
Nov 08 21:39:05 user nova-compute[75993]:   </devices>
Nov 08 21:39:05 user nova-compute[75993]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 08 21:39:05 user nova-compute[75993]:     <label>libvirt-c68ac7dc-3b4f-4d34-946d-86e8726c38af</label>
Nov 08 21:39:05 user nova-compute[75993]:     <imagelabel>libvirt-c68ac7dc-3b4f-4d34-946d-86e8726c38af</imagelabel>
Nov 08 21:39:05 user nova-compute[75993]:   </seclabel>
Nov 08 21:39:05 user nova-compute[75993]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 08 21:39:05 user nova-compute[75993]:     <label>+64055:+108</label>
Nov 08 21:39:05 user nova-compute[75993]:     <imagelabel>+64055:+108</imagelabel>
Nov 08 21:39:05 user nova-compute[75993]:   </seclabel>
Nov 08 21:39:05 user nova-compute[75993]: </domain>
Nov 08 21:39:05 user nova-compute[75993]:  {{(pid=75993) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 08 21:39:05 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Detaching interface fa:16:3e:b7:2f:f0 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap21e2ed5b-c9' not found.
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686990095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686990095',id=7,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIYNlWsNYNXIPzYxHJHsqWLqulGXulk0Teiy9wHphwJUB1UKtAxuCAT9/nMP58cJKIagHsE3mNVjHBFc2GKI4Bsmrn42N0sgHxg9hFcGJDRyLkXho/6LRS6t4SoMazlhg==',key_name='tempest-keypair-1407039979',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3144772c95b74eecbd2a1781114cfb77',ramdisk_id='',reservation_id='r-5deny31q',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487427237',owner_user_name='tempest-TaggedAttachmentsTest-1487427237-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b13e1fc5636403f88aee213e6d70e7d',uuid=c68ac7dc-3b4f-4d34-946d-86e8726c38af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] Converting VIF {"id": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "address": "fa:16:3e:b7:2f:f0", "network": {"id": "0bcc505f-3ce9-4f2e-81bd-4b96d65610a5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1153402838", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21e2ed5b-c9", "ovs_interfaceid": "21e2ed5b-c9b3-42f2-b19b-26fdb450de38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG os_vif [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21e2ed5b-c9, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:39:05 user nova-compute[75993]: INFO os_vif [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:2f:f0,bridge_name='br-int',has_traffic_filtering=True,id=21e2ed5b-c9b3-42f2-b19b-26fdb450de38,network=Network(0bcc505f-3ce9-4f2e-81bd-4b96d65610a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21e2ed5b-c9')
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [req-eec17841-1942-42dc-844a-5c12e095af73 req-ca5033ee-017d-48fc-98a9-43f7a03878b5 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:39:05 user nova-compute[75993]:   <nova:package version="0.0.0"/>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:name>tempest-device-tagging-server-686990095</nova:name>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:creationTime>2023-11-08 21:39:05</nova:creationTime>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:flavor name="m1.tiny">
Nov 08 21:39:05 user nova-compute[75993]:     <nova:memory>512</nova:memory>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:disk>1</nova:disk>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:swap>0</nova:swap>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:vcpus>1</nova:vcpus>
Nov 08 21:39:05 user nova-compute[75993]:   </nova:flavor>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:owner>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:user uuid="6b13e1fc5636403f88aee213e6d70e7d">tempest-TaggedAttachmentsTest-1487427237-project-member</nova:user>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:project uuid="3144772c95b74eecbd2a1781114cfb77">tempest-TaggedAttachmentsTest-1487427237</nova:project>
Nov 08 21:39:05 user nova-compute[75993]:   </nova:owner>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:39:05 user nova-compute[75993]:   <nova:ports>
Nov 08 21:39:05 user nova-compute[75993]:     <nova:port uuid="d05110a2-8c3f-492e-8f02-77d7e07983cb">
Nov 08 21:39:05 user nova-compute[75993]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 21:39:05 user nova-compute[75993]:     </nova:port>
Nov 08 21:39:05 user nova-compute[75993]:   </nova:ports>
Nov 08 21:39:05 user nova-compute[75993]: </nova:instance>
Nov 08 21:39:05 user nova-compute[75993]:  {{(pid=75993) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 08 21:39:05 user nova-compute[75993]: INFO nova.network.neutron [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Port 21e2ed5b-c9b3-42f2-b19b-26fdb450de38 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 08 21:39:05 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updating instance_info_cache with network_info: [{"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Releasing lock "refresh_cache-c68ac7dc-3b4f-4d34-946d-86e8726c38af" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e50841f0-869c-45b7-8cd6-4c9ced2aa638 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "interface-c68ac7dc-3b4f-4d34-946d-86e8726c38af-21e2ed5b-c9b3-42f2-b19b-26fdb450de38" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.255s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 req-83b23064-3d1c-4179-8d16-ff8f78d9abdf service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event volume-reimaged-d4af4d21-6fd7-4f91-9cf3-d8e66e91403e {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 req-83b23064-3d1c-4179-8d16-ff8f78d9abdf service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 req-83b23064-3d1c-4179-8d16-ff8f78d9abdf service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 req-83b23064-3d1c-4179-8d16-ff8f78d9abdf service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 req-83b23064-3d1c-4179-8d16-ff8f78d9abdf service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Processing event volume-reimaged-d4af4d21-6fd7-4f91-9cf3-d8e66e91403e {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Instance event wait completed in 46 seconds for volume-reimaged {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:39:07 user nova-compute[75993]: INFO nova.virt.block_device [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Booting with volume d4af4d21-6fd7-4f91-9cf3-d8e66e91403e at /dev/vda
Nov 08 21:39:07 user nova-compute[75993]: DEBUG os_brick.utils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[65db5b26-2235-453d-a333-0cc343cc683c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab46f7b2-6070-431c-b0ba-0d9930209c7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5120f0e-5ae0-41cc-b9d8-73383060042b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedf5bbc-2d84-41ca-9a90-72d7a23d4375]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:39:07 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ecf192-ba84-4be8-821d-21cc893899f8]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG os_brick.utils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Updating existing volume attachment record: 20a1f998-ff8e-42ae-90b2-6c59fd3bc4bd {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "96a0b785-b9b9-4d48-880e-e592aedc8c92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:39:07 user nova-compute[75993]: INFO nova.compute.claims [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Claim successful on node user
Nov 08 21:39:08 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:39:08 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:39:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:39:08 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Creating image(s)
Nov 08 21:39:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "/opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "/opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "/opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG nova.policy [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c9d198bd0b540b6839c534f99897aed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3754aebc3a46f2988be1bcf1319aa5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.212s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.237s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk 1073741824" returned: 0 in 0.059s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Successfully created port: b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.210s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Cannot resize image /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Ensure instance console log exists: /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.network.neutron [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Successfully updated port: b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "refresh_cache-96a0b785-b9b9-4d48-880e-e592aedc8c92" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquired lock "refresh_cache-96a0b785-b9b9-4d48-880e-e592aedc8c92" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.network.neutron [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.compute.manager [req-1813870b-dd50-4c81-ba04-5899af640f91 req-27c46a87-768a-4fd0-abba-a1b4f7d4645c service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Received event network-changed-b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.compute.manager [req-1813870b-dd50-4c81-ba04-5899af640f91 req-27c46a87-768a-4fd0-abba-a1b4f7d4645c service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Refreshing instance network info cache due to event network-changed-b69eb142-b291-4755-9c1a-265a3c4d7e5a. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1813870b-dd50-4c81-ba04-5899af640f91 req-27c46a87-768a-4fd0-abba-a1b4f7d4645c service nova] Acquiring lock "refresh_cache-96a0b785-b9b9-4d48-880e-e592aedc8c92" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.network.neutron [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.network.neutron [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Updating instance_info_cache with network_info: [{"id": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "address": "fa:16:3e:e5:86:af", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69eb142-b2", "ovs_interfaceid": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Releasing lock "refresh_cache-96a0b785-b9b9-4d48-880e-e592aedc8c92" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Instance network_info: |[{"id": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "address": "fa:16:3e:e5:86:af", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69eb142-b2", "ovs_interfaceid": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1813870b-dd50-4c81-ba04-5899af640f91 req-27c46a87-768a-4fd0-abba-a1b4f7d4645c service nova] Acquired lock "refresh_cache-96a0b785-b9b9-4d48-880e-e592aedc8c92" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.network.neutron [req-1813870b-dd50-4c81-ba04-5899af640f91 req-27c46a87-768a-4fd0-abba-a1b4f7d4645c service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Refreshing network info cache for port b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Start _get_guest_xml network_info=[{"id": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "address": "fa:16:3e:e5:86:af", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69eb142-b2", "ovs_interfaceid": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:39:10 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:39:10 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-197645581',display_name='tempest-VolumesAdminNegativeTest-server-197645581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-197645581',id=14,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb3754aebc3a46f2988be1bcf1319aa5',ramdisk_id='',reservation_id='r-afzr0034',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1328949075',owner_user_name='tempest-VolumesAdminNegativeTest-1328949075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:39:09Z,user_data=None,user_id='7c9d198bd0b540b6839c534f99897aed',uuid=96a0b785-b9b9-4d48-880e-e592aedc8c92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "address": "fa:16:3e:e5:86:af", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69eb142-b2", "ovs_interfaceid": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converting VIF {"id": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "address": "fa:16:3e:e5:86:af", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69eb142-b2", "ovs_interfaceid": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:86:af,bridge_name='br-int',has_traffic_filtering=True,id=b69eb142-b291-4755-9c1a-265a3c4d7e5a,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69eb142-b2') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:10 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lazy-loading 'pci_devices' on Instance uuid 96a0b785-b9b9-4d48-880e-e592aedc8c92 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:39:11 user nova-compute[75993]:   <uuid>96a0b785-b9b9-4d48-880e-e592aedc8c92</uuid>
Nov 08 21:39:11 user nova-compute[75993]:   <name>instance-0000000e</name>
Nov 08 21:39:11 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:39:11 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:39:11 user nova-compute[75993]:   <metadata>
Nov 08 21:39:11 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:39:11 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:39:11 user nova-compute[75993]:       <nova:name>tempest-VolumesAdminNegativeTest-server-197645581</nova:name>
Nov 08 21:39:11 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:39:10</nova:creationTime>
Nov 08 21:39:11 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:39:11 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:39:11 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:39:11 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:39:11 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:39:11 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:39:11 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:39:11 user nova-compute[75993]:       <nova:owner>
Nov 08 21:39:11 user nova-compute[75993]:         <nova:user uuid="7c9d198bd0b540b6839c534f99897aed">tempest-VolumesAdminNegativeTest-1328949075-project-member</nova:user>
Nov 08 21:39:11 user nova-compute[75993]:         <nova:project uuid="eb3754aebc3a46f2988be1bcf1319aa5">tempest-VolumesAdminNegativeTest-1328949075</nova:project>
Nov 08 21:39:11 user nova-compute[75993]:       </nova:owner>
Nov 08 21:39:11 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:39:11 user nova-compute[75993]:       <nova:ports>
Nov 08 21:39:11 user nova-compute[75993]:         <nova:port uuid="b69eb142-b291-4755-9c1a-265a3c4d7e5a">
Nov 08 21:39:11 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 21:39:11 user nova-compute[75993]:         </nova:port>
Nov 08 21:39:11 user nova-compute[75993]:       </nova:ports>
Nov 08 21:39:11 user nova-compute[75993]:     </nova:instance>
Nov 08 21:39:11 user nova-compute[75993]:   </metadata>
Nov 08 21:39:11 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:39:11 user nova-compute[75993]:     <system>
Nov 08 21:39:11 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:39:11 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:39:11 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:39:11 user nova-compute[75993]:       <entry name="serial">96a0b785-b9b9-4d48-880e-e592aedc8c92</entry>
Nov 08 21:39:11 user nova-compute[75993]:       <entry name="uuid">96a0b785-b9b9-4d48-880e-e592aedc8c92</entry>
Nov 08 21:39:11 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:39:11 user nova-compute[75993]:     </system>
Nov 08 21:39:11 user nova-compute[75993]:   </sysinfo>
Nov 08 21:39:11 user nova-compute[75993]:   <os>
Nov 08 21:39:11 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:39:11 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:39:11 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:39:11 user nova-compute[75993]:   </os>
Nov 08 21:39:11 user nova-compute[75993]:   <features>
Nov 08 21:39:11 user nova-compute[75993]:     <acpi/>
Nov 08 21:39:11 user nova-compute[75993]:     <apic/>
Nov 08 21:39:11 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:39:11 user nova-compute[75993]:   </features>
Nov 08 21:39:11 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:39:11 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:39:11 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:39:11 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:39:11 user nova-compute[75993]:   </clock>
Nov 08 21:39:11 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:39:11 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:39:11 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:39:11 user nova-compute[75993]:   </cpu>
Nov 08 21:39:11 user nova-compute[75993]:   <devices>
Nov 08 21:39:11 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:39:11 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:39:11 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk"/>
Nov 08 21:39:11 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:39:11 user nova-compute[75993]:     </disk>
Nov 08 21:39:11 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:39:11 user nova-compute[75993]:       <mac address="fa:16:3e:e5:86:af"/>
Nov 08 21:39:11 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:39:11 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:39:11 user nova-compute[75993]:       <target dev="tapb69eb142-b2"/>
Nov 08 21:39:11 user nova-compute[75993]:     </interface>
Nov 08 21:39:11 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:39:11 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/console.log" append="off"/>
Nov 08 21:39:11 user nova-compute[75993]:     </serial>
Nov 08 21:39:11 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:39:11 user nova-compute[75993]:     <video>
Nov 08 21:39:11 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:39:11 user nova-compute[75993]:     </video>
Nov 08 21:39:11 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:39:11 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:39:11 user nova-compute[75993]:     </rng>
Nov 08 21:39:11 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:39:11 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:39:11 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:39:11 user nova-compute[75993]:     </memballoon>
Nov 08 21:39:11 user nova-compute[75993]:   </devices>
Nov 08 21:39:11 user nova-compute[75993]: </domain>
Nov 08 21:39:11 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-197645581',display_name='tempest-VolumesAdminNegativeTest-server-197645581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-197645581',id=14,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb3754aebc3a46f2988be1bcf1319aa5',ramdisk_id='',reservation_id='r-afzr0034',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1328949075',owner_user_name='tempest-VolumesAdminNegativeTest-1328949075-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:39:09Z,user_data=None,user_id='7c9d198bd0b540b6839c534f99897aed',uuid=96a0b785-b9b9-4d48-880e-e592aedc8c92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "address": "fa:16:3e:e5:86:af", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69eb142-b2", "ovs_interfaceid": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converting VIF {"id": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "address": "fa:16:3e:e5:86:af", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69eb142-b2", "ovs_interfaceid": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:86:af,bridge_name='br-int',has_traffic_filtering=True,id=b69eb142-b291-4755-9c1a-265a3c4d7e5a,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69eb142-b2') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG os_vif [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:86:af,bridge_name='br-int',has_traffic_filtering=True,id=b69eb142-b291-4755-9c1a-265a3c4d7e5a,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69eb142-b2') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95eaca05-68d4-5532-be87-f520af33634d', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb69eb142-b2, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb69eb142-b2, col_values=(('qos', UUID('8d813cb5-2b2f-4c88-83e2-1da484306773')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb69eb142-b2, col_values=(('external_ids', {'iface-id': 'b69eb142-b291-4755-9c1a-265a3c4d7e5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:86:af', 'vm-uuid': '96a0b785-b9b9-4d48-880e-e592aedc8c92'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:11 user nova-compute[75993]: INFO os_vif [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:86:af,bridge_name='br-int',has_traffic_filtering=True,id=b69eb142-b291-4755-9c1a-265a3c4d7e5a,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69eb142-b2')
Nov 08 21:39:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] No VIF found with MAC fa:16:3e:e5:86:af, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG nova.network.neutron [req-1813870b-dd50-4c81-ba04-5899af640f91 req-27c46a87-768a-4fd0-abba-a1b4f7d4645c service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Updated VIF entry in instance network info cache for port b69eb142-b291-4755-9c1a-265a3c4d7e5a. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG nova.network.neutron [req-1813870b-dd50-4c81-ba04-5899af640f91 req-27c46a87-768a-4fd0-abba-a1b4f7d4645c service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Updating instance_info_cache with network_info: [{"id": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "address": "fa:16:3e:e5:86:af", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69eb142-b2", "ovs_interfaceid": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:39:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1813870b-dd50-4c81-ba04-5899af640f91 req-27c46a87-768a-4fd0-abba-a1b4f7d4645c service nova] Releasing lock "refresh_cache-96a0b785-b9b9-4d48-880e-e592aedc8c92" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:39:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-01b5038a-5cb4-40d2-83b8-9459d74d0200 req-dcb38b00-0805-44a9-83bc-3f148102d97c service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Received event network-vif-plugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-01b5038a-5cb4-40d2-83b8-9459d74d0200 req-dcb38b00-0805-44a9-83bc-3f148102d97c service nova] Acquiring lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-01b5038a-5cb4-40d2-83b8-9459d74d0200 req-dcb38b00-0805-44a9-83bc-3f148102d97c service nova] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-01b5038a-5cb4-40d2-83b8-9459d74d0200 req-dcb38b00-0805-44a9-83bc-3f148102d97c service nova] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-01b5038a-5cb4-40d2-83b8-9459d74d0200 req-dcb38b00-0805-44a9-83bc-3f148102d97c service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] No waiting events found dispatching network-vif-plugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:13 user nova-compute[75993]: WARNING nova.compute.manager [req-01b5038a-5cb4-40d2-83b8-9459d74d0200 req-dcb38b00-0805-44a9-83bc-3f148102d97c service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Received unexpected event network-vif-plugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a for instance with vm_state building and task_state spawning.
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:39:15 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Instance spawned successfully.
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:15 user nova-compute[75993]: INFO nova.compute.manager [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Took 6.62 seconds to spawn the instance on the hypervisor.
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-6a8e4e21-05d8-4708-a3e6-f51410034a77 req-42b0f354-a8dd-4ba6-bfd5-4ddcf83b5789 service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Received event network-vif-plugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6a8e4e21-05d8-4708-a3e6-f51410034a77 req-42b0f354-a8dd-4ba6-bfd5-4ddcf83b5789 service nova] Acquiring lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6a8e4e21-05d8-4708-a3e6-f51410034a77 req-42b0f354-a8dd-4ba6-bfd5-4ddcf83b5789 service nova] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6a8e4e21-05d8-4708-a3e6-f51410034a77 req-42b0f354-a8dd-4ba6-bfd5-4ddcf83b5789 service nova] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-6a8e4e21-05d8-4708-a3e6-f51410034a77 req-42b0f354-a8dd-4ba6-bfd5-4ddcf83b5789 service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] No waiting events found dispatching network-vif-plugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:15 user nova-compute[75993]: WARNING nova.compute.manager [req-6a8e4e21-05d8-4708-a3e6-f51410034a77 req-42b0f354-a8dd-4ba6-bfd5-4ddcf83b5789 service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Received unexpected event network-vif-plugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a for instance with vm_state building and task_state spawning.
Nov 08 21:39:15 user nova-compute[75993]: INFO nova.compute.manager [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Took 7.59 seconds to build instance.
Nov 08 21:39:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ffe64322-bb44-4733-9ad7-ab42c593c41f tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.770s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:39:27 user nova-compute[75993]: INFO nova.compute.manager [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] instance snapshotting
Nov 08 21:39:27 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Beginning live snapshot process
Nov 08 21:39:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json -f qcow2 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json -f qcow2 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoqocoq98/28dac6c12a3a49b9afdcb3281094dbf2.delta 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpoqocoq98/28dac6c12a3a49b9afdcb3281094dbf2.delta 1073741824" returned: 0 in 0.065s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:28 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 21:39:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] COPY block job progress, current cursor: 75038720 final cursor: 75563008 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:29 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 21:39:30 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:39:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoqocoq98/28dac6c12a3a49b9afdcb3281094dbf2.delta /opt/stack/data/nova/instances/snapshots/tmpoqocoq98/28dac6c12a3a49b9afdcb3281094dbf2 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpoqocoq98/28dac6c12a3a49b9afdcb3281094dbf2.delta /opt/stack/data/nova/instances/snapshots/tmpoqocoq98/28dac6c12a3a49b9afdcb3281094dbf2" returned: 0 in 0.689s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:30 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Snapshot extracted, beginning image upload
Nov 08 21:39:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:33 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Snapshot image upload complete
Nov 08 21:39:33 user nova-compute[75993]: INFO nova.compute.manager [None req-3a2b52e2-4036-45e0-a563-9ea1a49c95a7 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Took 6.69 seconds to snapshot the instance on the hypervisor.
Nov 08 21:39:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:34 user nova-compute[75993]: INFO nova.compute.manager [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Terminating instance
Nov 08 21:39:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-40329848-8532-471a-8701-34a2a40e0d64 req-7a0e1aee-da50-444a-8323-8b03db4bdd4a service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-vif-unplugged-d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-40329848-8532-471a-8701-34a2a40e0d64 req-7a0e1aee-da50-444a-8323-8b03db4bdd4a service nova] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-40329848-8532-471a-8701-34a2a40e0d64 req-7a0e1aee-da50-444a-8323-8b03db4bdd4a service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-40329848-8532-471a-8701-34a2a40e0d64 req-7a0e1aee-da50-444a-8323-8b03db4bdd4a service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-40329848-8532-471a-8701-34a2a40e0d64 req-7a0e1aee-da50-444a-8323-8b03db4bdd4a service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] No waiting events found dispatching network-vif-unplugged-d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-40329848-8532-471a-8701-34a2a40e0d64 req-7a0e1aee-da50-444a-8323-8b03db4bdd4a service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-vif-unplugged-d05110a2-8c3f-492e-8f02-77d7e07983cb for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:35 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Instance destroyed successfully.
Nov 08 21:39:35 user nova-compute[75993]: DEBUG nova.objects.instance [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lazy-loading 'resources' on Instance uuid c68ac7dc-3b4f-4d34-946d-86e8726c38af {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:34:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-686990095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-686990095',id=7,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIYNlWsNYNXIPzYxHJHsqWLqulGXulk0Teiy9wHphwJUB1UKtAxuCAT9/nMP58cJKIagHsE3mNVjHBFc2GKI4Bsmrn42N0sgHxg9hFcGJDRyLkXho/6LRS6t4SoMazlhg==',key_name='tempest-keypair-1407039979',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3144772c95b74eecbd2a1781114cfb77',ramdisk_id='',reservation_id='r-5deny31q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1487427237',owner_user_name='tempest-TaggedAttachmentsTest-1487427237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:34:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b13e1fc5636403f88aee213e6d70e7d',uuid=c68ac7dc-3b4f-4d34-946d-86e8726c38af,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converting VIF {"id": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "address": "fa:16:3e:61:e1:be", "network": {"id": "20c8e227-ffd2-41cd-9947-93c3ec9371aa", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1443271443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3144772c95b74eecbd2a1781114cfb77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd05110a2-8c", "ovs_interfaceid": "d05110a2-8c3f-492e-8f02-77d7e07983cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:e1:be,bridge_name='br-int',has_traffic_filtering=True,id=d05110a2-8c3f-492e-8f02-77d7e07983cb,network=Network(20c8e227-ffd2-41cd-9947-93c3ec9371aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd05110a2-8c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG os_vif [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:e1:be,bridge_name='br-int',has_traffic_filtering=True,id=d05110a2-8c3f-492e-8f02-77d7e07983cb,network=Network(20c8e227-ffd2-41cd-9947-93c3ec9371aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd05110a2-8c') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd05110a2-8c, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac060513-ccf9-464e-9ea0-f9c846360e5f) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:35 user nova-compute[75993]: INFO os_vif [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:e1:be,bridge_name='br-int',has_traffic_filtering=True,id=d05110a2-8c3f-492e-8f02-77d7e07983cb,network=Network(20c8e227-ffd2-41cd-9947-93c3ec9371aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd05110a2-8c')
Nov 08 21:39:35 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Deleting instance files /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af_del
Nov 08 21:39:35 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Deletion of /opt/stack/data/nova/instances/c68ac7dc-3b4f-4d34-946d-86e8726c38af_del complete
Nov 08 21:39:35 user nova-compute[75993]: INFO nova.compute.manager [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 08 21:39:35 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:39:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:36 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:39:36 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Took 1.15 seconds to deallocate network for instance.
Nov 08 21:39:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "5a45a70a-a723-43c9-8233-862ea146e6f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:39:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-42e1d3c8-136d-4c2e-a267-e151145581dd req-595b9660-539e-4926-a702-97e34aad6d5c service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-vif-plugged-d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42e1d3c8-136d-4c2e-a267-e151145581dd req-595b9660-539e-4926-a702-97e34aad6d5c service nova] Acquiring lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42e1d3c8-136d-4c2e-a267-e151145581dd req-595b9660-539e-4926-a702-97e34aad6d5c service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-42e1d3c8-136d-4c2e-a267-e151145581dd req-595b9660-539e-4926-a702-97e34aad6d5c service nova] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-42e1d3c8-136d-4c2e-a267-e151145581dd req-595b9660-539e-4926-a702-97e34aad6d5c service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] No waiting events found dispatching network-vif-plugged-d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:36 user nova-compute[75993]: WARNING nova.compute.manager [req-42e1d3c8-136d-4c2e-a267-e151145581dd req-595b9660-539e-4926-a702-97e34aad6d5c service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received unexpected event network-vif-plugged-d05110a2-8c3f-492e-8f02-77d7e07983cb for instance with vm_state deleted and task_state None.
Nov 08 21:39:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-42e1d3c8-136d-4c2e-a267-e151145581dd req-595b9660-539e-4926-a702-97e34aad6d5c service nova] [instance: c68ac7dc-3b4f-4d34-946d-86e8726c38af] Received event network-vif-deleted-d05110a2-8c3f-492e-8f02-77d7e07983cb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.572s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.401s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:39:37 user nova-compute[75993]: INFO nova.compute.claims [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Claim successful on node user
Nov 08 21:39:37 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Deleted allocations for instance c68ac7dc-3b4f-4d34-946d-86e8726c38af
Nov 08 21:39:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-67c66dd2-8e4d-4c4c-b841-07087d0c6646 tempest-TaggedAttachmentsTest-1487427237 tempest-TaggedAttachmentsTest-1487427237-project-member] Lock "c68ac7dc-3b4f-4d34-946d-86e8726c38af" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.950s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:39:37 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:39:37 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:39:37 user nova-compute[75993]: DEBUG nova.policy [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ab412f002ec4fe1b978f874d53a2229', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872f700d69d8494f9076e7f0d58e14d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:39:38 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Creating image(s)
Nov 08 21:39:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "/opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "/opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "ee0d64456b8465d68052be7a5636715591e6ea5b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "ee0d64456b8465d68052be7a5636715591e6ea5b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:39:38 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Creating image(s)
Nov 08 21:39:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Ensure instance console log exists: /opt/stack/data/nova/instances/1299c29d-4c41-43c5-ad63-7eae393065d4/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Start _get_guest_xml network_info=[{"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '20a1f998-ff8e-42ae-90b2-6c59fd3bc4bd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQxklKTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1299c29d-4c41-43c5-ad63-7eae393065d4', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 'serial': 'd4af4d21-6fd7-4f91-9cf3-d8e66e91403e'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b.part --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLDoRSAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f0d20870-4544-428f-8963-4e358845514c', 'attached_at': '', 'detached_at': '', 'volume_id': '88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'serial': '88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtfNAmha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'bf0a422a-57f7-4f07-a32f-6d6a4845ba7b'}, 'status': 'reserved', 'instance': 'f0d20870-4544-428f-8963-4e358845514c', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf0a422a-57f7-4f07-a32f-6d6a4845ba7b', 'serial'} {{(pid=75993) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Successfully created port: d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLDoRSAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:39:39 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:39:39 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:39:39 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:39:39 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:39:39 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:39:39 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 21:39:39 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 21:39:39 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.objects.instance [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'flavor' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[81cace07-2efa-4535-82cb-38ef25d39a34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:39:39 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.objects.instance [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1299c29d-4c41-43c5-ad63-7eae393065d4 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquired lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.network.neutron [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:39:39 user nova-compute[75993]: DEBUG nova.objects.instance [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'info_cache' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.046s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6de75a-43d2-41ee-aa13-a696e4956a9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf] added
Nov 08 21:39:40 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b.part --force-share --output=json" returned: 0 in 0.346s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQxklKTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:39:40 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG nova.virt.images [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] 93889cb1-4a42-41b5-9227-41c622b05f0f was qcow2, converting to raw {{(pid=75993) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b.part /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b.converted {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c313ca55-2ca2-4102-870a-205da9d43243]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG nova.objects.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[626e7ec2-84eb-4d54-a4f6-108b14912842]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLDoRSAX {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pLDoRSAX" returned: 0 in 0.064s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a230cc4f-1dd5-408b-9577-b01b2960d82a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pLDoRSAX'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463f87f-c743-4036-8ee9-03681595cf4d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Acquiring lock "1a014eaf-7813-445b-b783-282ea30f034c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "1a014eaf-7813-445b-b783-282ea30f034c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Acquiring lock "1a014eaf-7813-445b-b783-282ea30f034c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "1a014eaf-7813-445b-b783-282ea30f034c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "1a014eaf-7813-445b-b783-282ea30f034c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:40 user nova-compute[75993]: INFO nova.compute.manager [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Terminating instance
Nov 08 21:39:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.083s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe90af72-46d2-4736-9efb-bf4654054617]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b.part /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b.converted" returned: 0 in 0.370s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b.converted --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --login" returned: 0 in 0.132s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[466133fa-b326-4eee-a725-3602787b5b32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260]
Nov 08 21:39:40 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260] successful.
Nov 08 21:39:40 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.047s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb36db-3fb8-4175-af67-0d46dcd58811]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a517f06e-3d55-485c-8aab-3286089da716]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:40 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:40 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.900s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] HCTL ('38', '-', '-', 0) found on session 18 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b550818-ec7b-42e6-bcd0-eaae35739403]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Searching for a device in session 18 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLDoRSAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b.converted --force-share --output=json" returned: 0 in 0.270s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "ee0d64456b8465d68052be7a5636715591e6ea5b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.799s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-49564dac-774e-411f-ac92-b1b4b1221b59 req-5f022380-b21d-4781-a8ac-3a5cc3855820 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Received event network-vif-unplugged-cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-49564dac-774e-411f-ac92-b1b4b1221b59 req-5f022380-b21d-4781-a8ac-3a5cc3855820 service nova] Acquiring lock "1a014eaf-7813-445b-b783-282ea30f034c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-49564dac-774e-411f-ac92-b1b4b1221b59 req-5f022380-b21d-4781-a8ac-3a5cc3855820 service nova] Lock "1a014eaf-7813-445b-b783-282ea30f034c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-49564dac-774e-411f-ac92-b1b4b1221b59 req-5f022380-b21d-4781-a8ac-3a5cc3855820 service nova] Lock "1a014eaf-7813-445b-b783-282ea30f034c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-49564dac-774e-411f-ac92-b1b4b1221b59 req-5f022380-b21d-4781-a8ac-3a5cc3855820 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] No waiting events found dispatching network-vif-unplugged-cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-49564dac-774e-411f-ac92-b1b4b1221b59 req-5f022380-b21d-4781-a8ac-3a5cc3855820 service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Received event network-vif-unplugged-cb94076d-a437-4177-a03e-5464dbf40fd9 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updating instance_info_cache with network_info: [{"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b --force-share --output=json" returned: 0 in 0.260s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "ee0d64456b8465d68052be7a5636715591e6ea5b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "ee0d64456b8465d68052be7a5636715591e6ea5b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Releasing lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:39:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance destroyed successfully.
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.objects.instance [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'resources' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.objects.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69742388',display_name='tempest-AttachVolumeTestJSON-server-69742388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69742388',id=4,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6oVnaQGjrVAmxsL/HSmftgrrbaB7fw/oPsVgbPjyOcbxzfpKxxWenMze7QWGbAaraNrcOiGtYnTUSvQT2S8k2jlnDmVZFkcsfxNh5h1CEZ87atD5chgSwK78UubB8vnQ==',key_name='tempest-keypair-1705684380',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-ufo08u5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=35ca9fea-481a-42ac-8558-c5140e71de59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_vif [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c7b1cf2-c7, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db40437e-729d-46f2-9fc5-16625ed62498) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: INFO os_vif [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7')
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOXuFyJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:39:41 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b --force-share --output=json" returned: 0 in 0.209s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b,backing_fmt=raw /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b,backing_fmt=raw /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk 1073741824" returned: 0 in 0.067s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "ee0d64456b8465d68052be7a5636715591e6ea5b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Instance destroyed successfully.
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.objects.instance [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lazy-loading 'resources' on Instance uuid 1a014eaf-7813-445b-b783-282ea30f034c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Successfully updated port: d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1016544502',display_name='tempest-VolumesAssistedSnapshotsTest-server-1016544502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1016544502',id=8,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO3H8QsquBqmuvJsLiPW7MWd4mW5PWrjbnHwuK2LHLzFiERKgsyEPiEDVNcHhRK8EncaXqF3LVv67WXXwE4gE2kNe5/vaVrM2pBfpTvrUStS56JNt+FH8WYu2HZXqblJQ==',key_name='tempest-keypair-1544433234',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7a786ab12104e738a7075f06f65b1ed',ramdisk_id='',reservation_id='r-jemil0on',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1777990699',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1777990699-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:34:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c4ed3d04e034433ba25686e19d55541',uuid=1a014eaf-7813-445b-b783-282ea30f034c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb94076d-a437-4177-a03e-5464dbf40fd9", "address": "fa:16:3e:3a:56:bd", "network": {"id": "635bf144-0bb5-4dad-9f1d-25aac4b8c0ad", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-506377129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7a786ab12104e738a7075f06f65b1ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb94076d-a4", "ovs_interfaceid": "cb94076d-a437-4177-a03e-5464dbf40fd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Converting VIF {"id": "cb94076d-a437-4177-a03e-5464dbf40fd9", "address": "fa:16:3e:3a:56:bd", "network": {"id": "635bf144-0bb5-4dad-9f1d-25aac4b8c0ad", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-506377129-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7a786ab12104e738a7075f06f65b1ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb94076d-a4", "ovs_interfaceid": "cb94076d-a437-4177-a03e-5464dbf40fd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:56:bd,bridge_name='br-int',has_traffic_filtering=True,id=cb94076d-a437-4177-a03e-5464dbf40fd9,network=Network(635bf144-0bb5-4dad-9f1d-25aac4b8c0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb94076d-a4') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_vif [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:56:bd,bridge_name='br-int',has_traffic_filtering=True,id=cb94076d-a437-4177-a03e-5464dbf40fd9,network=Network(635bf144-0bb5-4dad-9f1d-25aac4b8c0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb94076d-a4') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb94076d-a4, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7d4d8a1-cb17-42d6-bfc4-6deee8b66a10) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquired lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:41 user nova-compute[75993]: INFO os_vif [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:56:bd,bridge_name='br-int',has_traffic_filtering=True,id=cb94076d-a437-4177-a03e-5464dbf40fd9,network=Network(635bf144-0bb5-4dad-9f1d-25aac4b8c0ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb94076d-a4')
Nov 08 21:39:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Deleting instance files /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c_del
Nov 08 21:39:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Deletion of /opt/stack/data/nova/instances/1a014eaf-7813-445b-b783-282ea30f034c_del complete
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:39:41 user nova-compute[75993]: INFO nova.compute.manager [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b --force-share --output=json" returned: 0 in 0.229s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Ensure instance console log exists: /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Updating instance_info_cache with network_info: [{"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.953s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] <== connect_volume: return (1955ms) {'type': 'block', 'scsi_wwn': '26265306137666638', 'path': '/dev/sdg'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265306137666638', 'path': '/dev/sdg'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.676s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:39:41 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:39:41 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.objects.instance [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lazy-loading 'flavor' on Instance uuid f0d20870-4544-428f-8963-4e358845514c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Releasing lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Instance network_info: |[{"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Start _get_guest_xml network_info=[{"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e665cbb291ce3c6a9639973a52e3a116',container_format='bare',created_at=2023-11-08T21:39:27Z,direct_url=<?>,disk_format='qcow2',id=93889cb1-4a42-41b5-9227-41c622b05f0f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1443805387',owner='872f700d69d8494f9076e7f0d58e14d3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T21:39:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '93889cb1-4a42-41b5-9227-41c622b05f0f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:39:41 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:39:41 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2479c3a-3dbd-4874-a0b8-76f57c6e656d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:39:41 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e665cbb291ce3c6a9639973a52e3a116',container_format='bare',created_at=2023-11-08T21:39:27Z,direct_url=<?>,disk_format='qcow2',id=93889cb1-4a42-41b5-9227-41c622b05f0f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1443805387',owner='872f700d69d8494f9076e7f0d58e14d3',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T21:39:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-305403190',display_name='tempest-TestStampPattern-server-305403190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-305403190',id=15,image_ref='93889cb1-4a42-41b5-9227-41c622b05f0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzi4BBwOWSPcXvNFJcnuunmlc1jVzPYxgIUIXRPn88VowR8XT4JMB17/mhLEw562KI2F8/I3ODTLYr6iRjeOTY7XOCMuEaybFzaDT0RveYsc2TN5uGVN/y+/gl9KBJK0g==',key_name='tempest-TestStampPattern-232827460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='872f700d69d8494f9076e7f0d58e14d3',ramdisk_id='',reservation_id='r-ymc2twhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9bb5a995-4872-4671-91ab-ca0127d65181',image_min_disk='1',image_min_ram='0',image_owner_id='872f700d69d8494f9076e7f0d58e14d3',image_owner_project_name='tempest-TestStampPattern-1350261875',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1350261875-project-member',image_user_id='0ab412f002ec4fe1b978f874d53a2229',network_allocated='True',owner_project_name='tempest-TestStampPattern-1350261875',owner_user_name='tempest-TestStampPattern-1350261875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:39:38Z,user_data=None,user_id='0ab412f002ec4fe1b978f874d53a2229',uuid=5a45a70a-a723-43c9-8233-862ea146e6f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converting VIF {"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9f:13,bridge_name='br-int',has_traffic_filtering=True,id=d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e76079-cf') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a45a70a-a723-43c9-8233-862ea146e6f1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c2239c-a84d-4811-af84-7fd4a66c04bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e] added
Nov 08 21:39:41 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:39:41 user nova-compute[75993]:   <uuid>5a45a70a-a723-43c9-8233-862ea146e6f1</uuid>
Nov 08 21:39:41 user nova-compute[75993]:   <name>instance-0000000f</name>
Nov 08 21:39:41 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:39:41 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:39:41 user nova-compute[75993]:   <metadata>
Nov 08 21:39:41 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:39:41 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:39:41 user nova-compute[75993]:       <nova:name>tempest-TestStampPattern-server-305403190</nova:name>
Nov 08 21:39:41 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:39:41</nova:creationTime>
Nov 08 21:39:41 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:39:41 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:39:41 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:39:41 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:39:41 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:39:41 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:39:41 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:39:41 user nova-compute[75993]:       <nova:owner>
Nov 08 21:39:41 user nova-compute[75993]:         <nova:user uuid="0ab412f002ec4fe1b978f874d53a2229">tempest-TestStampPattern-1350261875-project-member</nova:user>
Nov 08 21:39:41 user nova-compute[75993]:         <nova:project uuid="872f700d69d8494f9076e7f0d58e14d3">tempest-TestStampPattern-1350261875</nova:project>
Nov 08 21:39:41 user nova-compute[75993]:       </nova:owner>
Nov 08 21:39:41 user nova-compute[75993]:       <nova:root type="image" uuid="93889cb1-4a42-41b5-9227-41c622b05f0f"/>
Nov 08 21:39:41 user nova-compute[75993]:       <nova:ports>
Nov 08 21:39:41 user nova-compute[75993]:         <nova:port uuid="d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a">
Nov 08 21:39:41 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 21:39:41 user nova-compute[75993]:         </nova:port>
Nov 08 21:39:41 user nova-compute[75993]:       </nova:ports>
Nov 08 21:39:41 user nova-compute[75993]:     </nova:instance>
Nov 08 21:39:41 user nova-compute[75993]:   </metadata>
Nov 08 21:39:41 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:39:41 user nova-compute[75993]:     <system>
Nov 08 21:39:41 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:39:41 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:39:41 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:39:41 user nova-compute[75993]:       <entry name="serial">5a45a70a-a723-43c9-8233-862ea146e6f1</entry>
Nov 08 21:39:41 user nova-compute[75993]:       <entry name="uuid">5a45a70a-a723-43c9-8233-862ea146e6f1</entry>
Nov 08 21:39:41 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:39:41 user nova-compute[75993]:     </system>
Nov 08 21:39:41 user nova-compute[75993]:   </sysinfo>
Nov 08 21:39:41 user nova-compute[75993]:   <os>
Nov 08 21:39:41 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:39:41 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:39:41 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:39:41 user nova-compute[75993]:   </os>
Nov 08 21:39:41 user nova-compute[75993]:   <features>
Nov 08 21:39:41 user nova-compute[75993]:     <acpi/>
Nov 08 21:39:41 user nova-compute[75993]:     <apic/>
Nov 08 21:39:41 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:39:41 user nova-compute[75993]:   </features>
Nov 08 21:39:41 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:39:41 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:39:41 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:39:41 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:39:41 user nova-compute[75993]:   </clock>
Nov 08 21:39:41 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:39:41 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:39:41 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:39:41 user nova-compute[75993]:   </cpu>
Nov 08 21:39:41 user nova-compute[75993]:   <devices>
Nov 08 21:39:41 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:39:41 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:39:41 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk"/>
Nov 08 21:39:41 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:39:41 user nova-compute[75993]:     </disk>
Nov 08 21:39:41 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:39:41 user nova-compute[75993]:       <mac address="fa:16:3e:a9:9f:13"/>
Nov 08 21:39:41 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:39:41 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:39:41 user nova-compute[75993]:       <target dev="tapd3e76079-cf"/>
Nov 08 21:39:41 user nova-compute[75993]:     </interface>
Nov 08 21:39:41 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:39:41 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/console.log" append="off"/>
Nov 08 21:39:41 user nova-compute[75993]:     </serial>
Nov 08 21:39:41 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:39:41 user nova-compute[75993]:     <video>
Nov 08 21:39:41 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:39:41 user nova-compute[75993]:     </video>
Nov 08 21:39:41 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:39:41 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:39:41 user nova-compute[75993]:     </rng>
Nov 08 21:39:41 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:39:41 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:39:41 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:39:41 user nova-compute[75993]:     </memballoon>
Nov 08 21:39:41 user nova-compute[75993]:   </devices>
Nov 08 21:39:41 user nova-compute[75993]: </domain>
Nov 08 21:39:41 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-305403190',display_name='tempest-TestStampPattern-server-305403190',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-305403190',id=15,image_ref='93889cb1-4a42-41b5-9227-41c622b05f0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzi4BBwOWSPcXvNFJcnuunmlc1jVzPYxgIUIXRPn88VowR8XT4JMB17/mhLEw562KI2F8/I3ODTLYr6iRjeOTY7XOCMuEaybFzaDT0RveYsc2TN5uGVN/y+/gl9KBJK0g==',key_name='tempest-TestStampPattern-232827460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='872f700d69d8494f9076e7f0d58e14d3',ramdisk_id='',reservation_id='r-ymc2twhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9bb5a995-4872-4671-91ab-ca0127d65181',image_min_disk='1',image_min_ram='0',image_owner_id='872f700d69d8494f9076e7f0d58e14d3',image_owner_project_name='tempest-TestStampPattern-1350261875',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1350261875-project-member',image_user_id='0ab412f002ec4fe1b978f874d53a2229',network_allocated='True',owner_project_name='tempest-TestStampPattern-1350261875',owner_user_name='tempest-TestStampPattern-1350261875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:39:38Z,user_data=None,user_id='0ab412f002ec4fe1b978f874d53a2229',uuid=5a45a70a-a723-43c9-8233-862ea146e6f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converting VIF {"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9f:13,bridge_name='br-int',has_traffic_filtering=True,id=d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e76079-cf') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG os_vif [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9f:13,bridge_name='br-int',has_traffic_filtering=True,id=d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e76079-cf') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2335effb-effc-51e8-9125-5f672d42a22d', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3e76079-cf, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3e76079-cf, col_values=(('qos', UUID('cfe4588c-698b-4128-90ad-579c8495fda6')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3e76079-cf, col_values=(('external_ids', {'iface-id': 'd3e76079-cf26-4fd5-a7c0-1e5d82b3f48a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:9f:13', 'vm-uuid': '5a45a70a-a723-43c9-8233-862ea146e6f1'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97f45d8-640f-44c2-b337-abc7a2be42b5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:42 user nova-compute[75993]: INFO os_vif [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:9f:13,bridge_name='br-int',has_traffic_filtering=True,id=d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e76079-cf')
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[026a0320-49cb-48ee-995a-eec05eb7814c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQxklKTD {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQxklKTD" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3e1f7e-b578-4498-a0ae-e55a266ddac8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nQxklKTD'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ea4bdb-d8e0-4f84-ad90-8d9ee89c154f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] No VIF found with MAC fa:16:3e:a9:9f:13, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7960b4-a9c3-4eeb-bc84-e87ba64c0ee0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8114241d-19c3-4d88-a5a9-880c0b5aee67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260]
Nov 08 21:39:42 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260] successful.
Nov 08 21:39:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a36729-b013-405f-b661-4edc2daf6d0a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7720277-b155-415d-8bc9-eb191e0d06f0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:39:42 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.492s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] HCTL ('42', '-', '-', 0) found on session 19 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f026e97e-5abe-472d-9783-5fdec36a2781]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Searching for a device in session 19 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQxklKTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:39:42 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Took 1.01 seconds to deallocate network for instance.
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-d9db48c7-398e-44c6-baba-b584023cf5a9 req-d5421249-7600-40dc-a82f-ad42df56f1ee service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Received event network-vif-deleted-cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 156237824 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Received event network-vif-plugged-cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] Acquiring lock "1a014eaf-7813-445b-b783-282ea30f034c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] Lock "1a014eaf-7813-445b-b783-282ea30f034c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] Lock "1a014eaf-7813-445b-b783-282ea30f034c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] No waiting events found dispatching network-vif-plugged-cb94076d-a437-4177-a03e-5464dbf40fd9 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:43 user nova-compute[75993]: WARNING nova.compute.manager [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] [instance: 1a014eaf-7813-445b-b783-282ea30f034c] Received unexpected event network-vif-plugged-cb94076d-a437-4177-a03e-5464dbf40fd9 for instance with vm_state deleted and task_state None.
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received event network-changed-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Refreshing instance network info cache due to event network-changed-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] Acquiring lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] Acquired lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Refreshing network info cache for port d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.555s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] <== connect_volume: return (3231ms) {'type': 'block', 'scsi_wwn': '23236346230653931', 'path': '/dev/sdk'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236346230653931', 'path': '/dev/sdk'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.099s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.673s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d49b88-5993-46cf-8feb-8e13fa0c2748]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:39:43 user nova-compute[75993]: No targets found.
Nov 08 21:39:43 user nova-compute[75993]: iSNS:
Nov 08 21:39:43 user nova-compute[75993]: No targets found.
Nov 08 21:39:43 user nova-compute[75993]: STATIC:
Nov 08 21:39:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2
Nov 08 21:39:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47
Nov 08 21:39:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451
Nov 08 21:39:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:39:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d
Nov 08 21:39:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5
Nov 08 21:39:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:39:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:39:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b
Nov 08 21:39:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:43 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a
Nov 08 21:39:43 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:43 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:43 user nova-compute[75993]: FIRMWARE:
Nov 08 21:39:43 user nova-compute[75993]: No targets found.
Nov 08 21:39:43 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:39:43 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:39:43 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T21:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1446269913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1121926887',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtrasof5VVa4N8t9Ec62wXGBSSsbRBbjGULzKVdN0bVvyZ8swMlrLds8d3lYzELTg6JrOJuucCuAAXEYpOoJNoBGe6KIU1HN5gatSV5zcSocuW2xYg9jQETQ50lGSxPmQ==',key_name='tempest-keypair-601691060',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='586af433a3ee4cc387be213c0d0fca05',ramdisk_id='',reservation_id='r-sk248x4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-553177767',owner_user_name='tempest-ServerActionsV293TestJSON-553177767-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:39:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c4d6c12e8b64175af3777dbf15ee11e',uuid=1299c29d-4c41-43c5-ad63-7eae393065d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converting VIF {"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:39:43 user nova-compute[75993]:   <uuid>1299c29d-4c41-43c5-ad63-7eae393065d4</uuid>
Nov 08 21:39:43 user nova-compute[75993]:   <name>instance-00000009</name>
Nov 08 21:39:43 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:39:43 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:39:43 user nova-compute[75993]:   <metadata>
Nov 08 21:39:43 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:39:43 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:39:43 user nova-compute[75993]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1446269913</nova:name>
Nov 08 21:39:43 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:39:39</nova:creationTime>
Nov 08 21:39:43 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:39:43 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:39:43 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:39:43 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:39:43 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:39:43 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:39:43 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:39:43 user nova-compute[75993]:       <nova:owner>
Nov 08 21:39:43 user nova-compute[75993]:         <nova:user uuid="0c4d6c12e8b64175af3777dbf15ee11e">tempest-ServerActionsV293TestJSON-553177767-project-member</nova:user>
Nov 08 21:39:43 user nova-compute[75993]:         <nova:project uuid="586af433a3ee4cc387be213c0d0fca05">tempest-ServerActionsV293TestJSON-553177767</nova:project>
Nov 08 21:39:43 user nova-compute[75993]:       </nova:owner>
Nov 08 21:39:43 user nova-compute[75993]:       <nova:ports>
Nov 08 21:39:43 user nova-compute[75993]:         <nova:port uuid="39262978-025e-4d08-a52b-4f361719f74a">
Nov 08 21:39:43 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 21:39:43 user nova-compute[75993]:         </nova:port>
Nov 08 21:39:43 user nova-compute[75993]:       </nova:ports>
Nov 08 21:39:43 user nova-compute[75993]:     </nova:instance>
Nov 08 21:39:43 user nova-compute[75993]:   </metadata>
Nov 08 21:39:43 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:39:43 user nova-compute[75993]:     <system>
Nov 08 21:39:43 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:39:43 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:39:43 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:39:43 user nova-compute[75993]:       <entry name="serial">1299c29d-4c41-43c5-ad63-7eae393065d4</entry>
Nov 08 21:39:43 user nova-compute[75993]:       <entry name="uuid">1299c29d-4c41-43c5-ad63-7eae393065d4</entry>
Nov 08 21:39:43 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:39:43 user nova-compute[75993]:     </system>
Nov 08 21:39:43 user nova-compute[75993]:   </sysinfo>
Nov 08 21:39:43 user nova-compute[75993]:   <os>
Nov 08 21:39:43 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:39:43 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:39:43 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:39:43 user nova-compute[75993]:   </os>
Nov 08 21:39:43 user nova-compute[75993]:   <features>
Nov 08 21:39:43 user nova-compute[75993]:     <acpi/>
Nov 08 21:39:43 user nova-compute[75993]:     <apic/>
Nov 08 21:39:43 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:39:43 user nova-compute[75993]:   </features>
Nov 08 21:39:43 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:39:43 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:39:43 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:39:43 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:39:43 user nova-compute[75993]:   </clock>
Nov 08 21:39:43 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:39:43 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:39:43 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:39:43 user nova-compute[75993]:   </cpu>
Nov 08 21:39:43 user nova-compute[75993]:   <devices>
Nov 08 21:39:43 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:39:43 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:39:43 user nova-compute[75993]:       <source dev="/dev/sdk"/>
Nov 08 21:39:43 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:39:43 user nova-compute[75993]:       <serial>d4af4d21-6fd7-4f91-9cf3-d8e66e91403e</serial>
Nov 08 21:39:43 user nova-compute[75993]:     </disk>
Nov 08 21:39:43 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:39:43 user nova-compute[75993]:       <mac address="fa:16:3e:c1:3f:07"/>
Nov 08 21:39:43 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:39:43 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:39:43 user nova-compute[75993]:       <target dev="tap39262978-02"/>
Nov 08 21:39:43 user nova-compute[75993]:     </interface>
Nov 08 21:39:43 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:39:43 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/1299c29d-4c41-43c5-ad63-7eae393065d4/console.log" append="off"/>
Nov 08 21:39:43 user nova-compute[75993]:     </serial>
Nov 08 21:39:43 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:39:43 user nova-compute[75993]:     <video>
Nov 08 21:39:43 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:39:43 user nova-compute[75993]:     </video>
Nov 08 21:39:43 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:39:43 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:39:43 user nova-compute[75993]:     </rng>
Nov 08 21:39:43 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:39:43 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:39:43 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:39:43 user nova-compute[75993]:     </memballoon>
Nov 08 21:39:43 user nova-compute[75993]:   </devices>
Nov 08 21:39:43 user nova-compute[75993]: </domain>
Nov 08 21:39:43 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T21:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1446269913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1121926887',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtrasof5VVa4N8t9Ec62wXGBSSsbRBbjGULzKVdN0bVvyZ8swMlrLds8d3lYzELTg6JrOJuucCuAAXEYpOoJNoBGe6KIU1HN5gatSV5zcSocuW2xYg9jQETQ50lGSxPmQ==',key_name='tempest-keypair-601691060',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='586af433a3ee4cc387be213c0d0fca05',ramdisk_id='',reservation_id='r-sk248x4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-553177767',owner_user_name='tempest-ServerActionsV293TestJSON-553177767-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:39:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c4d6c12e8b64175af3777dbf15ee11e',uuid=1299c29d-4c41-43c5-ad63-7eae393065d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converting VIF {"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_vif [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '237f453f-01ee-51bd-909b-cb3701e1f188', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:43 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Deleted allocations for instance 1a014eaf-7813-445b-b783-282ea30f034c
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5479fbb3-577a-48ff-8c7e-45dc1c190236]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 351272960 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39262978-02, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39262978-02, col_values=(('qos', UUID('af91ace4-14f5-4c41-bdc9-6f66fc3feadd')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39262978-02, col_values=(('external_ids', {'iface-id': '39262978-025e-4d08-a52b-4f361719f74a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:3f:07', 'vm-uuid': '1299c29d-4c41-43c5-ad63-7eae393065d4'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:43 user nova-compute[75993]: INFO os_vif [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02')
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.053s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b309ef6-f62e-40c0-879b-54bafd3f0335]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:43 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:39:43 user nova-compute[75993]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:43 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544ea7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24'): ({'sde'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Removing single pathed devices sde {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[aead00c9-341d-4690-b01a-184d99ff4e01]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b81e85-f834-4384-99bf-c616dad40b28]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Flushing IO for device /dev/sde {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] No VIF found with MAC fa:16:3e:c1:3f:07, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Updated VIF entry in instance network info cache for port d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Updating instance_info_cache with network_info: [{"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.175s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56d8785-c0ba-49ca-9717-05d4e779fb98]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-823132c3-e924-4ecb-8ae1-2a2e97f01084 req-578a0720-9fe6-4549-9e3e-41839b7270ea service nova] Releasing lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.092s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddf6d99-7bd3-43b0-b1cd-139e0b840ca5]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] SCSI volumes sde have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-32a654ba-4dd1-43a8-a20c-208bf9b33501 tempest-VolumesAssistedSnapshotsTest-1777990699 tempest-VolumesAssistedSnapshotsTest-1777990699-project-member] Lock "1a014eaf-7813-445b-b783-282ea30f034c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.501s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.070s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb269c4-04f3-40ec-9c6e-3e105f837ce0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 427819008 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.147s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a036c2f-1ce3-4e7c-b17a-fb53e5718885]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260]
Nov 08 21:39:44 user nova-compute[75993]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260] successful.
Nov 08 21:39:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.070s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf950eb-de44-4f53-a11c-158353c96693]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.836s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] <== disconnect_volume: return (2935ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Start _get_guest_xml network_info=[{"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '83b53332-da14-4b93-ab40-ddf5b5bd4dfd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOXuFyJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '35ca9fea-481a-42ac-8558-c5140e71de59', 'attached_at': '', 'detached_at': '', 'volume_id': 'e2ab3823-e622-43bb-8f66-0e85981a3e24', 'serial': 'e2ab3823-e622-43bb-8f66-0e85981a3e24'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.objects.instance [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'numa_topology' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.objects.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:39:44 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:39:44 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.objects.instance [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.objects.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOXuFyJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:39:44 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:39:44 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:39:44 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:39:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e147bb7-18bb-4860-ba43-924f0993da33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:39:44 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7658cfc-0dd1-4c38-aaea-bf7ecbbe539a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24] added
Nov 08 21:39:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d712bc07-87d4-438d-83b8-8ce5eecd4d09]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[750c6582-b464-46c5-a391-cf5e0b55e27a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOXuFyJH {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cOXuFyJH" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fca177c-f635-4a85-bdf5-ba11587c85a0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cOXuFyJH'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 589299712 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.037s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[39419f61-737e-4cb0-b76b-8f28e4278a4d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da29223-5be3-4db0-9674-d70bf3b8ea34]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:39:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:39:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --login" returned: 0 in 0.199s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d005284b-dc10-45e1-a537-2371579458c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260]
Nov 08 21:39:44 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260] successful.
Nov 08 21:39:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-4bd42a09-23d6-4304-90e3-834d5d48daa0 req-2f7968a8-6c3a-4046-b132-eb971b8c1fcf service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received event network-vif-plugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4bd42a09-23d6-4304-90e3-834d5d48daa0 req-2f7968a8-6c3a-4046-b132-eb971b8c1fcf service nova] Acquiring lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4bd42a09-23d6-4304-90e3-834d5d48daa0 req-2f7968a8-6c3a-4046-b132-eb971b8c1fcf service nova] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4bd42a09-23d6-4304-90e3-834d5d48daa0 req-2f7968a8-6c3a-4046-b132-eb971b8c1fcf service nova] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-4bd42a09-23d6-4304-90e3-834d5d48daa0 req-2f7968a8-6c3a-4046-b132-eb971b8c1fcf service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] No waiting events found dispatching network-vif-plugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:44 user nova-compute[75993]: WARNING nova.compute.manager [req-4bd42a09-23d6-4304-90e3-834d5d48daa0 req-2f7968a8-6c3a-4046-b132-eb971b8c1fcf service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received unexpected event network-vif-plugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a for instance with vm_state building and task_state spawning.
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d55e42-601e-49be-8f01-b51f34c94427]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9893cf68-5a60-46e4-9569-9c7c10716496]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:39:44 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.539s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60b5ac7-8a34-4403-a77c-9e5e9568f596]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:39:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 726663168 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 882900992 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:39:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOXuFyJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:39:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.583s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:39:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] <== connect_volume: return (1585ms) {'type': 'block', 'scsi_wwn': '26435316665356364', 'path': '/dev/sde'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:39:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435316665356364', 'path': '/dev/sde'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69742388',display_name='tempest-AttachVolumeTestJSON-server-69742388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69742388',id=4,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6oVnaQGjrVAmxsL/HSmftgrrbaB7fw/oPsVgbPjyOcbxzfpKxxWenMze7QWGbAaraNrcOiGtYnTUSvQT2S8k2jlnDmVZFkcsfxNh5h1CEZ87atD5chgSwK78UubB8vnQ==',key_name='tempest-keypair-1705684380',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-ufo08u5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=35ca9fea-481a-42ac-8558-c5140e71de59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'pci_devices' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.objects.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:39:46 user nova-compute[75993]:   <uuid>35ca9fea-481a-42ac-8558-c5140e71de59</uuid>
Nov 08 21:39:46 user nova-compute[75993]:   <name>instance-00000004</name>
Nov 08 21:39:46 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:39:46 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:39:46 user nova-compute[75993]:   <metadata>
Nov 08 21:39:46 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:39:46 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:39:46 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeTestJSON-server-69742388</nova:name>
Nov 08 21:39:46 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:39:44</nova:creationTime>
Nov 08 21:39:46 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:39:46 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:39:46 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:39:46 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:39:46 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:39:46 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:39:46 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:39:46 user nova-compute[75993]:       <nova:owner>
Nov 08 21:39:46 user nova-compute[75993]:         <nova:user uuid="9276d87f95734c47897fba9ea4fe2d94">tempest-AttachVolumeTestJSON-1483084463-project-member</nova:user>
Nov 08 21:39:46 user nova-compute[75993]:         <nova:project uuid="00def573657242f289160a6a74dd8ad3">tempest-AttachVolumeTestJSON-1483084463</nova:project>
Nov 08 21:39:46 user nova-compute[75993]:       </nova:owner>
Nov 08 21:39:46 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:39:46 user nova-compute[75993]:       <nova:ports>
Nov 08 21:39:46 user nova-compute[75993]:         <nova:port uuid="8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2">
Nov 08 21:39:46 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 21:39:46 user nova-compute[75993]:         </nova:port>
Nov 08 21:39:46 user nova-compute[75993]:       </nova:ports>
Nov 08 21:39:46 user nova-compute[75993]:     </nova:instance>
Nov 08 21:39:46 user nova-compute[75993]:   </metadata>
Nov 08 21:39:46 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:39:46 user nova-compute[75993]:     <system>
Nov 08 21:39:46 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:39:46 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:39:46 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:39:46 user nova-compute[75993]:       <entry name="serial">35ca9fea-481a-42ac-8558-c5140e71de59</entry>
Nov 08 21:39:46 user nova-compute[75993]:       <entry name="uuid">35ca9fea-481a-42ac-8558-c5140e71de59</entry>
Nov 08 21:39:46 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:39:46 user nova-compute[75993]:     </system>
Nov 08 21:39:46 user nova-compute[75993]:   </sysinfo>
Nov 08 21:39:46 user nova-compute[75993]:   <os>
Nov 08 21:39:46 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:39:46 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:39:46 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:39:46 user nova-compute[75993]:   </os>
Nov 08 21:39:46 user nova-compute[75993]:   <features>
Nov 08 21:39:46 user nova-compute[75993]:     <acpi/>
Nov 08 21:39:46 user nova-compute[75993]:     <apic/>
Nov 08 21:39:46 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:39:46 user nova-compute[75993]:   </features>
Nov 08 21:39:46 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:39:46 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:39:46 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:39:46 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:39:46 user nova-compute[75993]:   </clock>
Nov 08 21:39:46 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:39:46 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:39:46 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:39:46 user nova-compute[75993]:   </cpu>
Nov 08 21:39:46 user nova-compute[75993]:   <devices>
Nov 08 21:39:46 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:39:46 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:39:46 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk"/>
Nov 08 21:39:46 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:39:46 user nova-compute[75993]:     </disk>
Nov 08 21:39:46 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:39:46 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:39:46 user nova-compute[75993]:       <source dev="/dev/sde"/>
Nov 08 21:39:46 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:39:46 user nova-compute[75993]:       <serial>e2ab3823-e622-43bb-8f66-0e85981a3e24</serial>
Nov 08 21:39:46 user nova-compute[75993]:     </disk>
Nov 08 21:39:46 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:39:46 user nova-compute[75993]:       <mac address="fa:16:3e:9e:8c:e8"/>
Nov 08 21:39:46 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:39:46 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:39:46 user nova-compute[75993]:       <target dev="tap8c7b1cf2-c7"/>
Nov 08 21:39:46 user nova-compute[75993]:     </interface>
Nov 08 21:39:46 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:39:46 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/console.log" append="off"/>
Nov 08 21:39:46 user nova-compute[75993]:     </serial>
Nov 08 21:39:46 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:39:46 user nova-compute[75993]:     <video>
Nov 08 21:39:46 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:39:46 user nova-compute[75993]:     </video>
Nov 08 21:39:46 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:39:46 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:39:46 user nova-compute[75993]:     </rng>
Nov 08 21:39:46 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:39:46 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:39:46 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:39:46 user nova-compute[75993]:     </memballoon>
Nov 08 21:39:46 user nova-compute[75993]:   </devices>
Nov 08 21:39:46 user nova-compute[75993]: </domain>
Nov 08 21:39:46 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 1049624576 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'trusted_certs' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-33cf58a0-d5a0-4d22-a8b8-85cb784cea95 req-a75be128-6d9d-4317-89bc-267a66d53310 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33cf58a0-d5a0-4d22-a8b8-85cb784cea95 req-a75be128-6d9d-4317-89bc-267a66d53310 service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33cf58a0-d5a0-4d22-a8b8-85cb784cea95 req-a75be128-6d9d-4317-89bc-267a66d53310 service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33cf58a0-d5a0-4d22-a8b8-85cb784cea95 req-a75be128-6d9d-4317-89bc-267a66d53310 service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-33cf58a0-d5a0-4d22-a8b8-85cb784cea95 req-a75be128-6d9d-4317-89bc-267a66d53310 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:46 user nova-compute[75993]: WARNING nova.compute.manager [req-33cf58a0-d5a0-4d22-a8b8-85cb784cea95 req-a75be128-6d9d-4317-89bc-267a66d53310 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received unexpected event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a for instance with vm_state active and task_state rebuild_spawning.
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.objects.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtfNAmha', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'bf0a422a-57f7-4f07-a32f-6d6a4845ba7b'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:39:46 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.231s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2498862-90dc-4b8d-aa65-bf99bde2d2ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:39:46 user nova-compute[75993]: No targets found.
Nov 08 21:39:46 user nova-compute[75993]: iSNS:
Nov 08 21:39:46 user nova-compute[75993]: No targets found.
Nov 08 21:39:46 user nova-compute[75993]: STATIC:
Nov 08 21:39:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2
Nov 08 21:39:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47
Nov 08 21:39:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451
Nov 08 21:39:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:39:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d
Nov 08 21:39:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5
Nov 08 21:39:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:39:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:39:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b
Nov 08 21:39:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a
Nov 08 21:39:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:39:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:39:46 user nova-compute[75993]: FIRMWARE:
Nov 08 21:39:46 user nova-compute[75993]: No targets found.
Nov 08 21:39:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:39:46 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:39:46 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ff3f34-1438-4eba-9fd1-2721262ee6f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-d63a7b53-201f-46c9-8f12-7a96ecc3e9cc req-113e1257-bcaf-4667-a2d7-ed14c2137fbf service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received event network-vif-plugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d63a7b53-201f-46c9-8f12-7a96ecc3e9cc req-113e1257-bcaf-4667-a2d7-ed14c2137fbf service nova] Acquiring lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d63a7b53-201f-46c9-8f12-7a96ecc3e9cc req-113e1257-bcaf-4667-a2d7-ed14c2137fbf service nova] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d63a7b53-201f-46c9-8f12-7a96ecc3e9cc req-113e1257-bcaf-4667-a2d7-ed14c2137fbf service nova] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-d63a7b53-201f-46c9-8f12-7a96ecc3e9cc req-113e1257-bcaf-4667-a2d7-ed14c2137fbf service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] No waiting events found dispatching network-vif-plugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:46 user nova-compute[75993]: WARNING nova.compute.manager [req-d63a7b53-201f-46c9-8f12-7a96ecc3e9cc req-113e1257-bcaf-4667-a2d7-ed14c2137fbf service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received unexpected event network-vif-plugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a for instance with vm_state building and task_state spawning.
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c5368f-badd-4a50-b79d-64b733853ceb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:39:46 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:39:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544f90e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f087d4-004f-4961-b078-6645506648b4]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d2d5b5-325a-4f87-95bd-17976c94a072]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[095b5dad-abc3-4b94-ad67-24587ecb68b7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:39:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Cannot resize image /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG nova.objects.instance [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'migration_context' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG nova.objects.base [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69742388',display_name='tempest-AttachVolumeTestJSON-server-69742388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69742388',id=4,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6oVnaQGjrVAmxsL/HSmftgrrbaB7fw/oPsVgbPjyOcbxzfpKxxWenMze7QWGbAaraNrcOiGtYnTUSvQT2S8k2jlnDmVZFkcsfxNh5h1CEZ87atD5chgSwK78UubB8vnQ==',key_name='tempest-keypair-1705684380',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-ufo08u5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:37:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=35ca9fea-481a-42ac-8558-c5140e71de59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG os_vif [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd6f3e4-c8ec-4d6c-a225-76e31777baad]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95f43a20-3158-5e1a-be00-087d33226317', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c7b1cf2-c7, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c7b1cf2-c7, col_values=(('qos', UUID('8efd1976-7a03-4bf0-a669-c569fd8d7f5e')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c7b1cf2-c7, col_values=(('external_ids', {'iface-id': '8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:8c:e8', 'vm-uuid': '35ca9fea-481a-42ac-8558-c5140e71de59'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2fbd90-6360-4f7d-ab33-aeba14219d11]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:47 user nova-compute[75993]: INFO os_vif [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7')
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2e9382-994c-4932-928f-d08bb315f269]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b, portal: 172.16.0.220,3260]
Nov 08 21:39:47 user nova-compute[75993]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b, portal: 172.16.0.220,3260] successful.
Nov 08 21:39:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf0a422a-57f7-4f07-a32f-6d6a4845ba7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f569a1-55d4-4f63-adad-30d2ae57f34c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] <== disconnect_volume: return (434ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLDoRSAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'f0d20870-4544-428f-8963-4e358845514c', 'attached_at': '', 'detached_at': '', 'volume_id': '88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'serial'} {{(pid=75993) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 08 21:39:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] swap_volume: removing Cinder connection for volume bf0a422a-57f7-4f07-a32f-6d6a4845ba7b {{(pid=75993) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:39:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Instance spawned successfully.
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:48 user nova-compute[75993]: INFO nova.compute.manager [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Took 10.20 seconds to spawn the instance on the hypervisor.
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] [instance: f0d20870-4544-428f-8963-4e358845514c] swap_volume: Updating volume bf0a422a-57f7-4f07-a32f-6d6a4845ba7b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "pLDoRSAX", "auth_password": "zpyiAONI23eugj", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf"}, "status": "reserved", "instance": "f0d20870-4544-428f-8963-4e358845514c", "attached_at": "", "detached_at": "", "volume_id": "88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf", "serial": "88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'no_device': None, 'attachment_id': '243dbd36-7d5e-47ae-a425-4d1aced70812'} {{(pid=75993) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-976747fe-ef9d-454e-bbf0-e467c226d52b tempest-TestVolumeSwap-142447479 tempest-TestVolumeSwap-142447479-project-admin] Lock "f0d20870-4544-428f-8963-4e358845514c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 54.697s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:48 user nova-compute[75993]: INFO nova.compute.manager [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Took 11.63 seconds to build instance.
Nov 08 21:39:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f814a9bc-4c88-4820-8b0e-b701680e9204 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.760s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-583de87f-f678-4d05-88e3-fa31161b3f4d req-059b990d-25ba-4729-8716-dfd7fc0142c0 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-583de87f-f678-4d05-88e3-fa31161b3f4d req-059b990d-25ba-4729-8716-dfd7fc0142c0 service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-583de87f-f678-4d05-88e3-fa31161b3f4d req-059b990d-25ba-4729-8716-dfd7fc0142c0 service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-583de87f-f678-4d05-88e3-fa31161b3f4d req-059b990d-25ba-4729-8716-dfd7fc0142c0 service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-583de87f-f678-4d05-88e3-fa31161b3f4d req-059b990d-25ba-4729-8716-dfd7fc0142c0 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:48 user nova-compute[75993]: WARNING nova.compute.manager [req-583de87f-f678-4d05-88e3-fa31161b3f4d req-059b990d-25ba-4729-8716-dfd7fc0142c0 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received unexpected event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a for instance with vm_state active and task_state rebuild_spawning.
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-bf89ee5e-06b2-48ad-956d-f154f1810be3 req-023d82b6-aeb1-4422-8117-502e0ca210c0 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bf89ee5e-06b2-48ad-956d-f154f1810be3 req-023d82b6-aeb1-4422-8117-502e0ca210c0 service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bf89ee5e-06b2-48ad-956d-f154f1810be3 req-023d82b6-aeb1-4422-8117-502e0ca210c0 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bf89ee5e-06b2-48ad-956d-f154f1810be3 req-023d82b6-aeb1-4422-8117-502e0ca210c0 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-bf89ee5e-06b2-48ad-956d-f154f1810be3 req-023d82b6-aeb1-4422-8117-502e0ca210c0 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:48 user nova-compute[75993]: WARNING nova.compute.manager [req-bf89ee5e-06b2-48ad-956d-f154f1810be3 req-023d82b6-aeb1-4422-8117-502e0ca210c0 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received unexpected event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with vm_state stopped and task_state powering-on.
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:39:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Instance spawned successfully.
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG nova.objects.instance [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75993) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:49 user nova-compute[75993]: INFO nova.compute.manager [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Detaching volume 88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9a404def-ad6a-43b8-85a6-de2e8ebb4763 tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.115s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:49 user nova-compute[75993]: INFO nova.virt.block_device [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Attempting to driver detach volume 88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf from mountpoint /dev/vdb
Nov 08 21:39:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Attempting to detach device vdb from instance f0d20870-4544-428f-8963-4e358845514c from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:39:49 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:39:49 user nova-compute[75993]:   <source dev="/dev/sdg"/>
Nov 08 21:39:49 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:39:49 user nova-compute[75993]:   <serial>88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf</serial>
Nov 08 21:39:49 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:39:49 user nova-compute[75993]: </disk>
Nov 08 21:39:49 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:39:49 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Successfully detached device vdb from instance f0d20870-4544-428f-8963-4e358845514c from the persistent domain config.
Nov 08 21:39:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f0d20870-4544-428f-8963-4e358845514c from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:39:49 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:39:49 user nova-compute[75993]:   <source dev="/dev/sdg"/>
Nov 08 21:39:49 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:39:49 user nova-compute[75993]:   <serial>88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf</serial>
Nov 08 21:39:49 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:39:49 user nova-compute[75993]: </disk>
Nov 08 21:39:49 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f0d20870-4544-428f-8963-4e358845514c] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:39:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f0d20870-4544-428f-8963-4e358845514c {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:39:50 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f0d20870-4544-428f-8963-4e358845514c] Updating instance_info_cache with network_info: [{"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:39:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-f0d20870-4544-428f-8963-4e358845514c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:39:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f0d20870-4544-428f-8963-4e358845514c] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:39:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-b5ebcc4f-384b-4b87-8002-149a00439f06 req-ff083da8-b41d-43b4-9951-30da67ad81a0 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:39:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b5ebcc4f-384b-4b87-8002-149a00439f06 req-ff083da8-b41d-43b4-9951-30da67ad81a0 service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b5ebcc4f-384b-4b87-8002-149a00439f06 req-ff083da8-b41d-43b4-9951-30da67ad81a0 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b5ebcc4f-384b-4b87-8002-149a00439f06 req-ff083da8-b41d-43b4-9951-30da67ad81a0 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-b5ebcc4f-384b-4b87-8002-149a00439f06 req-ff083da8-b41d-43b4-9951-30da67ad81a0 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:39:50 user nova-compute[75993]: WARNING nova.compute.manager [req-b5ebcc4f-384b-4b87-8002-149a00439f06 req-ff083da8-b41d-43b4-9951-30da67ad81a0 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received unexpected event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with vm_state stopped and task_state powering-on.
Nov 08 21:39:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:39:51 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance rebooted successfully.
Nov 08 21:39:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-131cc32a-610f-4b2a-bb98-6722f3a9dd77 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:39:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:51 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:39:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:39:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:39:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:39:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:39:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:39:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:39:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdj (vdc) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:39:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.271s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:39:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:39:57 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:39:57 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7522MB free_disk=25.37893295288086GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 35ca9fea-481a-42ac-8558-c5140e71de59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f0d20870-4544-428f-8963-4e358845514c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1299c29d-4c41-43c5-ad63-7eae393065d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9bb5a995-4872-4671-91ab-ca0127d65181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 81c8325d-776c-4171-86eb-26f83b7dde00 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 96a0b785-b9b9-4d48-880e-e592aedc8c92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 5a45a70a-a723-43c9-8233-862ea146e6f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:39:57 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.970s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 21:39:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:00 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:40:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:09 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f0d20870-4544-428f-8963-4e358845514c is timed out.
Nov 08 21:40:09 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Successfully detached device vdb from instance f0d20870-4544-428f-8963-4e358845514c from the live domain config.
Nov 08 21:40:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:40:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pLDoRSAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:40:09 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:40:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:40:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:40:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d349245f-dc90-47c0-816a-cb66db726022]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:40:09 user nova-compute[75993]: No targets found.
Nov 08 21:40:09 user nova-compute[75993]: iSNS:
Nov 08 21:40:09 user nova-compute[75993]: No targets found.
Nov 08 21:40:09 user nova-compute[75993]: STATIC:
Nov 08 21:40:09 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2
Nov 08 21:40:09 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:09 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:09 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47
Nov 08 21:40:09 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:09 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:09 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451
Nov 08 21:40:09 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:09 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:09 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf
Nov 08 21:40:09 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:09 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:09 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d
Nov 08 21:40:09 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:09 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:09 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5
Nov 08 21:40:09 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:09 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:09 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:40:09 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:09 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:09 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:40:09 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:09 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:09 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a
Nov 08 21:40:09 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:09 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:09 user nova-compute[75993]: FIRMWARE:
Nov 08 21:40:09 user nova-compute[75993]: No targets found.
Nov 08 21:40:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:40:09 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:40:09 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:40:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:40:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada13a57-ae32-4c4a-8318-09f3bdfe9a53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7690fcc-2c0a-4964-a9c9-c9f8da5f3080]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:10 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:10 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:10 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544d620e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf'): ({'sdg'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Removing single pathed devices sdg {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.056s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[76acfaf3-b674-43da-9442-330344713409]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.067s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[487dcf71-7dd4-478c-a07d-7646b8ae62bb]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Flushing IO for device /dev/sdg {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[14729844-b069-4222-a0ab-ad99bf7aa38e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.096s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b7efb6-09e9-4d44-8680-fc766afa6462]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] SCSI volumes sdg have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.070s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a116a-6e20-4964-a5a0-5b16ced4da89]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.129s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c2cce7-7eef-4ebe-9ccb-0bbf1d26eeab]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260]
Nov 08 21:40:10 user nova-compute[75993]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf, portal: 172.16.0.220,3260] successful.
Nov 08 21:40:10 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88bb71dc-0ea4-402a-bb21-e7a6a34ac7cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[304acba6-3a76-4ba9-9c88-5aa8a23a1ae2]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.676s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] <== disconnect_volume: return (677ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:40:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:11 user nova-compute[75993]: DEBUG nova.objects.instance [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lazy-loading 'flavor' on Instance uuid f0d20870-4544-428f-8963-4e358845514c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:40:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-bb3765a6-7317-4348-97e0-7f1cf280d283 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.526s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-bf887622-4df4-4b4a-a3fe-9e671d1effc4 req-503dd3da-7269-4e9f-8ff3-8ec5582c93e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-changed-8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-bf887622-4df4-4b4a-a3fe-9e671d1effc4 req-503dd3da-7269-4e9f-8ff3-8ec5582c93e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing instance network info cache due to event network-changed-8061d712-84a3-4484-9af3-7a721ba39201. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:40:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bf887622-4df4-4b4a-a3fe-9e671d1effc4 req-503dd3da-7269-4e9f-8ff3-8ec5582c93e6 service nova] Acquiring lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:40:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bf887622-4df4-4b4a-a3fe-9e671d1effc4 req-503dd3da-7269-4e9f-8ff3-8ec5582c93e6 service nova] Acquired lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:40:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-bf887622-4df4-4b4a-a3fe-9e671d1effc4 req-503dd3da-7269-4e9f-8ff3-8ec5582c93e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Refreshing network info cache for port 8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:40:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-bf887622-4df4-4b4a-a3fe-9e671d1effc4 req-503dd3da-7269-4e9f-8ff3-8ec5582c93e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updated VIF entry in instance network info cache for port 8061d712-84a3-4484-9af3-7a721ba39201. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:40:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-bf887622-4df4-4b4a-a3fe-9e671d1effc4 req-503dd3da-7269-4e9f-8ff3-8ec5582c93e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [{"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bf50bddc-3f74-4d9e-9003-e8075806a131", "address": "fa:16:3e:5e:15:67", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf50bddc-3f", "ovs_interfaceid": "bf50bddc-3f74-4d9e-9003-e8075806a131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bf887622-4df4-4b4a-a3fe-9e671d1effc4 req-503dd3da-7269-4e9f-8ff3-8ec5582c93e6 service nova] Releasing lock "refresh_cache-f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:40:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-76d390d9-20db-4e25-b797-851302a3d64e req-85be7fff-ce2f-40a6-bc6e-e877f5917078 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-changed-be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-76d390d9-20db-4e25-b797-851302a3d64e req-85be7fff-ce2f-40a6-bc6e-e877f5917078 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing instance network info cache due to event network-changed-be74d5f7-6805-471f-8295-c60479f28e95. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:40:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-76d390d9-20db-4e25-b797-851302a3d64e req-85be7fff-ce2f-40a6-bc6e-e877f5917078 service nova] Acquiring lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:40:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-76d390d9-20db-4e25-b797-851302a3d64e req-85be7fff-ce2f-40a6-bc6e-e877f5917078 service nova] Acquired lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:40:24 user nova-compute[75993]: DEBUG nova.network.neutron [req-76d390d9-20db-4e25-b797-851302a3d64e req-85be7fff-ce2f-40a6-bc6e-e877f5917078 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Refreshing network info cache for port be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-76d390d9-20db-4e25-b797-851302a3d64e req-85be7fff-ce2f-40a6-bc6e-e877f5917078 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updated VIF entry in instance network info cache for port be74d5f7-6805-471f-8295-c60479f28e95. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-76d390d9-20db-4e25-b797-851302a3d64e req-85be7fff-ce2f-40a6-bc6e-e877f5917078 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [{"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-76d390d9-20db-4e25-b797-851302a3d64e req-85be7fff-ce2f-40a6-bc6e-e877f5917078 service nova] Releasing lock "refresh_cache-81c8325d-776c-4171-86eb-26f83b7dde00" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:25 user nova-compute[75993]: INFO nova.compute.manager [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Terminating instance
Nov 08 21:40:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-53eba3d2-3c0c-420c-9550-c8650222ecf4 req-3c3f6d22-b1fe-49dc-ada4-68ddef87df85 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-53eba3d2-3c0c-420c-9550-c8650222ecf4 req-3c3f6d22-b1fe-49dc-ada4-68ddef87df85 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-53eba3d2-3c0c-420c-9550-c8650222ecf4 req-3c3f6d22-b1fe-49dc-ada4-68ddef87df85 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-53eba3d2-3c0c-420c-9550-c8650222ecf4 req-3c3f6d22-b1fe-49dc-ada4-68ddef87df85 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-53eba3d2-3c0c-420c-9550-c8650222ecf4 req-3c3f6d22-b1fe-49dc-ada4-68ddef87df85 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-unplugged-8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-53eba3d2-3c0c-420c-9550-c8650222ecf4 req-3c3f6d22-b1fe-49dc-ada4-68ddef87df85 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-8061d712-84a3-4484-9af3-7a721ba39201 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-e355e55b-8b4c-47f4-ba3c-db5968232a6e req-606d3fde-879e-46cc-82fb-9b33d5c32f9a service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e355e55b-8b4c-47f4-ba3c-db5968232a6e req-606d3fde-879e-46cc-82fb-9b33d5c32f9a service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e355e55b-8b4c-47f4-ba3c-db5968232a6e req-606d3fde-879e-46cc-82fb-9b33d5c32f9a service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e355e55b-8b4c-47f4-ba3c-db5968232a6e req-606d3fde-879e-46cc-82fb-9b33d5c32f9a service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-e355e55b-8b4c-47f4-ba3c-db5968232a6e req-606d3fde-879e-46cc-82fb-9b33d5c32f9a service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-unplugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-e355e55b-8b4c-47f4-ba3c-db5968232a6e req-606d3fde-879e-46cc-82fb-9b33d5c32f9a service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-be84b3ab-58d0-455a-912d-b754f01691aa req-5bb0d91e-bd45-492f-a44f-9df1c31618be service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be84b3ab-58d0-455a-912d-b754f01691aa req-5bb0d91e-bd45-492f-a44f-9df1c31618be service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be84b3ab-58d0-455a-912d-b754f01691aa req-5bb0d91e-bd45-492f-a44f-9df1c31618be service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be84b3ab-58d0-455a-912d-b754f01691aa req-5bb0d91e-bd45-492f-a44f-9df1c31618be service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-be84b3ab-58d0-455a-912d-b754f01691aa req-5bb0d91e-bd45-492f-a44f-9df1c31618be service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-unplugged-bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-be84b3ab-58d0-455a-912d-b754f01691aa req-5bb0d91e-bd45-492f-a44f-9df1c31618be service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-bf50bddc-3f74-4d9e-9003-e8075806a131 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Instance destroyed successfully.
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lazy-loading 'resources' on Instance uuid f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6f:a0:da,bridge_name='br-int',has_traffic_filtering=True,id=8061d712-84a3-4484-9af3-7a721ba39201,network=Network(decf3cff-055f-4d6b-9784-4cd1aa517767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8061d712-84') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:a0:da,bridge_name='br-int',has_traffic_filtering=True,id=8061d712-84a3-4484-9af3-7a721ba39201,network=Network(decf3cff-055f-4d6b-9784-4cd1aa517767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8061d712-84') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8061d712-84, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27176fb1-f843-48e2-b4d2-9a952f943134) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: INFO os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6f:a0:da,bridge_name='br-int',has_traffic_filtering=True,id=8061d712-84a3-4484-9af3-7a721ba39201,network=Network(decf3cff-055f-4d6b-9784-4cd1aa517767),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8061d712-84')
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:99:3f,bridge_name='br-int',has_traffic_filtering=True,id=d4d60025-cd29-4e1d-a98c-d4c6e222914f,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4d60025-cd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:99:3f,bridge_name='br-int',has_traffic_filtering=True,id=d4d60025-cd29-4e1d-a98c-d4c6e222914f,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4d60025-cd') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4d60025-cd, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ca12b47-63c2-461d-8445-f168c552d112) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: INFO os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:99:3f,bridge_name='br-int',has_traffic_filtering=True,id=d4d60025-cd29-4e1d-a98c-d4c6e222914f,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd4d60025-cd')
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=03bc5876-9344-412e-b868-0efe6d1a2b87,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03bc5876-93') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=03bc5876-9344-412e-b868-0efe6d1a2b87,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03bc5876-93') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03bc5876-93, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ea69c58-26ef-4b76-b071-33c4af41dbbe) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: INFO os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2d:d9,bridge_name='br-int',has_traffic_filtering=True,id=03bc5876-9344-412e-b868-0efe6d1a2b87,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap03bc5876-93')
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=64c7f448-31f1-4983-8137-35563482e00c,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c7f448-31') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=64c7f448-31f1-4983-8137-35563482e00c,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c7f448-31') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64c7f448-31, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9d91e85-bac8-4e4b-8699-0dfb47ad4e2c) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: INFO os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:1b:26,bridge_name='br-int',has_traffic_filtering=True,id=64c7f448-31f1-4983-8137-35563482e00c,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c7f448-31')
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:a5:74,bridge_name='br-int',has_traffic_filtering=True,id=e8c4fb3e-981c-45b4-9ed3-cea1605128fb,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c4fb3e-98') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:a5:74,bridge_name='br-int',has_traffic_filtering=True,id=e8c4fb3e-981c-45b4-9ed3-cea1605128fb,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c4fb3e-98') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8c4fb3e-98, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24efbc1e-eb84-462f-8f1d-514f13faf265) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: INFO os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:a5:74,bridge_name='br-int',has_traffic_filtering=True,id=e8c4fb3e-981c-45b4-9ed3-cea1605128fb,network=Network(541cd4aa-e7f2-4821-be04-b402e722ceff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8c4fb3e-98')
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf50bddc-3f74-4d9e-9003-e8075806a131", "address": "fa:16:3e:5e:15:67", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf50bddc-3f", "ovs_interfaceid": "bf50bddc-3f74-4d9e-9003-e8075806a131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "bf50bddc-3f74-4d9e-9003-e8075806a131", "address": "fa:16:3e:5e:15:67", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf50bddc-3f", "ovs_interfaceid": "bf50bddc-3f74-4d9e-9003-e8075806a131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bf50bddc-3f74-4d9e-9003-e8075806a131,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf50bddc-3f') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bf50bddc-3f74-4d9e-9003-e8075806a131,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf50bddc-3f') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf50bddc-3f, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a57bd2d-a69d-4a20-8715-f104f45014d9) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: INFO os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:15:67,bridge_name='br-int',has_traffic_filtering=True,id=bf50bddc-3f74-4d9e-9003-e8075806a131,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf50bddc-3f')
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:35:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-131849376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-131849376',id=12,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM66ntRfmlSD6YehTTPbLLgRsqamaxkw8dAiuEzqLgTW527CbNLZjCmDjATT6o3+OLkjEe0io/ZbeNCrodFGisDA/VRJ242dJgMzlb8wgk5QXdLBJrAvE9nRPdwbP0q5bQ==',key_name='tempest-keypair-1721826304',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:38:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1e556b7998d44018428c2753f5d22df',ramdisk_id='',reservation_id='r-evww05u7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1945801815',owner_user_name='tempest-TaggedBootDevicesTest-1945801815-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:38:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6147fd63937f48389f54a418c8ba2a21',uuid=f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converting VIF {"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:86:ab,bridge_name='br-int',has_traffic_filtering=True,id=a4197c5a-1660-4d86-97ce-ac19cbc419a9,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4197c5a-16') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:86:ab,bridge_name='br-int',has_traffic_filtering=True,id=a4197c5a-1660-4d86-97ce-ac19cbc419a9,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4197c5a-16') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4197c5a-16, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88e1a5dc-3856-470f-94fc-a1a07df6b8c0) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:28 user nova-compute[75993]: INFO os_vif [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:86:ab,bridge_name='br-int',has_traffic_filtering=True,id=a4197c5a-1660-4d86-97ce-ac19cbc419a9,network=Network(f4303d49-4c87-4f52-8692-365d75a587ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4197c5a-16')
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMGIFEZm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:40:28 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b90f86-f9b2-4dfb-a4c6-1d79a2fe69ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:40:28 user nova-compute[75993]: No targets found.
Nov 08 21:40:28 user nova-compute[75993]: iSNS:
Nov 08 21:40:28 user nova-compute[75993]: No targets found.
Nov 08 21:40:28 user nova-compute[75993]: STATIC:
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: FIRMWARE:
Nov 08 21:40:28 user nova-compute[75993]: No targets found.
Nov 08 21:40:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:40:28 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:40:28 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c82606-e507-4870-9bfa-3ba6fb79cffd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:28 user nova-compute[75993]: WARNING nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-8061d712-84a3-4484-9af3-7a721ba39201 for instance with vm_state active and task_state deleting.
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-unplugged-64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-64c7f448-31f1-4983-8137-35563482e00c for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:28 user nova-compute[75993]: WARNING nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-64c7f448-31f1-4983-8137-35563482e00c for instance with vm_state active and task_state deleting.
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-unplugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:28 user nova-compute[75993]: WARNING nova.compute.manager [req-0cecdb19-f60f-4986-bac8-8fb16d14e2b4 req-66e9dbe6-6179-42ec-984b-d2e82f48c884 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-e8c4fb3e-981c-45b4-9ed3-cea1605128fb for instance with vm_state active and task_state deleting.
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a960595-91a6-4a77-91f3-8b269fa42091]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544d1f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d'): ({'sdh'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Removing single pathed devices sdh {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[280f1ec6-860b-4ee0-96af-05b2d6d7df98]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[79edf7b1-d3b4-43c6-ad55-a6872474d6d1]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Flushing IO for device /dev/sdh {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8a8d0f-9a09-475e-98ff-beb44fe95bfd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd9458b-9b58-4a38-b6f7-ecdead5e473e]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] SCSI volumes sdh have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67bcd51-abb4-41e3-8d01-d1cdef399e43]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b7b0a0-075e-4eb8-b947-6ae36054fec6]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d, portal: 172.16.0.220,3260]
Nov 08 21:40:28 user nova-compute[75993]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d, portal: 172.16.0.220,3260] successful.
Nov 08 21:40:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:28 user nova-compute[75993]: WARNING nova.compute.manager [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-d4d60025-cd29-4e1d-a98c-d4c6e222914f for instance with vm_state active and task_state deleting.
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-03bc5876-9344-412e-b868-0efe6d1a2b87 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-unplugged-03bc5876-9344-412e-b868-0efe6d1a2b87 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-03bc5876-9344-412e-b868-0efe6d1a2b87 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-03bc5876-9344-412e-b868-0efe6d1a2b87 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-03bc5876-9344-412e-b868-0efe6d1a2b87 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:28 user nova-compute[75993]: WARNING nova.compute.manager [req-b279b79a-9bbe-4e1e-a3d2-82452f8ee098 req-202616d6-2789-4708-a1b0-b1d1beb45e16 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-03bc5876-9344-412e-b868-0efe6d1a2b87 for instance with vm_state active and task_state deleting.
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:878fed90-8eac-4987-9bd7-bf3aa880998d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.171s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b51dcc-85e8-4f28-b82d-a4080e8f0612]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.511s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] <== disconnect_volume: return (514ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "81c8325d-776c-4171-86eb-26f83b7dde00" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EciQlxYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:40:28 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:40:28 user nova-compute[75993]: INFO nova.compute.manager [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Terminating instance
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1b77a6-2090-4bc9-b8dd-cc5067c19933]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:40:28 user nova-compute[75993]: No targets found.
Nov 08 21:40:28 user nova-compute[75993]: iSNS:
Nov 08 21:40:28 user nova-compute[75993]: No targets found.
Nov 08 21:40:28 user nova-compute[75993]: STATIC:
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a
Nov 08 21:40:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:28 user nova-compute[75993]: FIRMWARE:
Nov 08 21:40:28 user nova-compute[75993]: No targets found.
Nov 08 21:40:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:40:28 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:40:28 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79d8acc-f308-4544-805a-417149801caa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f783918-e7e6-4825-b731-caa0ff78e323]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:28 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f856847f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a'): ({'sdi'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Removing single pathed devices sdi {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:28 user nova-compute[75993]: WARNING nova.compute.manager [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-bf50bddc-3f74-4d9e-9003-e8075806a131 for instance with vm_state active and task_state deleting.
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-unplugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-unplugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-plugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] No waiting events found dispatching network-vif-plugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:28 user nova-compute[75993]: WARNING nova.compute.manager [req-ccfcb050-1710-4371-85fb-bae09b00a9bf req-d6582ea0-e5b8-4e6f-b39f-faaf1ad559e6 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received unexpected event network-vif-plugged-a4197c5a-1660-4d86-97ce-ac19cbc419a9 for instance with vm_state active and task_state deleting.
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[585be324-6d42-497e-866b-c853941a77e0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[566b0ede-a27e-45cc-a11a-16dfa515b7e3]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Flushing IO for device /dev/sdi {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[240202be-e754-4802-8377-682b787bfab8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:40:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.061s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5c1feb-5ff9-4fe5-9243-ac503adf2bb6]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] SCSI volumes sdi have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aaeeed-2f88-45e6-b350-dcc2fe31a4d7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --logout" returned: 0 in 0.103s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b174daa3-c296-4741-9cd4-e3dd5353fa40]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a, portal: 172.16.0.220,3260]
Nov 08 21:40:29 user nova-compute[75993]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a, portal: 172.16.0.220,3260] successful.
Nov 08 21:40:29 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abd64a7d-2eb8-498d-996d-53642e92234a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[522f6dee-1949-4263-ac78-7de36dd3f639]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.526s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] <== disconnect_volume: return (529ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bJkqTxDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:40:29 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec3ea3f-62c7-4fcc-b32a-c11462ef9892]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:40:29 user nova-compute[75993]: No targets found.
Nov 08 21:40:29 user nova-compute[75993]: iSNS:
Nov 08 21:40:29 user nova-compute[75993]: No targets found.
Nov 08 21:40:29 user nova-compute[75993]: STATIC:
Nov 08 21:40:29 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2
Nov 08 21:40:29 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:29 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:29 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47
Nov 08 21:40:29 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:29 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:29 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451
Nov 08 21:40:29 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:29 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:29 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5
Nov 08 21:40:29 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:29 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:29 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:40:29 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:29 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:29 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:40:29 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:29 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:29 user nova-compute[75993]: FIRMWARE:
Nov 08 21:40:29 user nova-compute[75993]: No targets found.
Nov 08 21:40:29 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:40:29 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:40:29 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[040c1e2b-8eb3-401d-a1fd-715b6fde47a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee6e830-b539-466e-b0bb-46ea6afa1cf4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:40:29 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:40:29 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:29 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:29 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:29 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:29 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 (non-flash)
Nov 08 21:40:29 user nova-compute[75993]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:40:29 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:29 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:29 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:29 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:29 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544d4f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2'): ({'sdj'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Removing single pathed devices sdj {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfa2f32-cdae-4a6a-8a27-11360cb00994]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80e6bf1-589f-4ae4-9d9c-d9c2b240c31e]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Flushing IO for device /dev/sdj {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8d08ab-7db3-42a3-bc32-02f27ee31773]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.051s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4680dca2-f678-48d8-9df2-22059005e031]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] SCSI volumes sdj have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[235aeb59-0cf4-4d84-a8bc-b7cd5d8475e6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1872282a-b8c4-4b67-96e8-01e757857c4d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2, portal: 172.16.0.220,3260]
Nov 08 21:40:29 user nova-compute[75993]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2, portal: 172.16.0.220,3260] successful.
Nov 08 21:40:29 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a393c62a-ed47-4239-9da3-88971b8318d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[00810016-4d9c-4d72-bab7-c7744483c966]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] <== disconnect_volume: return (449ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:40:29 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Deleting instance files /opt/stack/data/nova/instances/f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1_del
Nov 08 21:40:29 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Deletion of /opt/stack/data/nova/instances/f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1_del complete
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:29 user nova-compute[75993]: INFO nova.compute.manager [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Took 4.14 seconds to destroy the instance on the hypervisor.
Nov 08 21:40:29 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:40:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-unplugged-be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-be74d5f7-6805-471f-8295-c60479f28e95 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:30 user nova-compute[75993]: WARNING nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-be74d5f7-6805-471f-8295-c60479f28e95 for instance with vm_state active and task_state deleting.
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-973638d8-8c22-4d53-9354-277bb212f9a0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-unplugged-973638d8-8c22-4d53-9354-277bb212f9a0 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-973638d8-8c22-4d53-9354-277bb212f9a0 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-973638d8-8c22-4d53-9354-277bb212f9a0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-973638d8-8c22-4d53-9354-277bb212f9a0 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:30 user nova-compute[75993]: WARNING nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-973638d8-8c22-4d53-9354-277bb212f9a0 for instance with vm_state active and task_state deleting.
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-unplugged-73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-73dee529-8844-464d-8f84-9f9abd1f77b3 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:30 user nova-compute[75993]: WARNING nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-73dee529-8844-464d-8f84-9f9abd1f77b3 for instance with vm_state active and task_state deleting.
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-unplugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-19c509ed-99c8-4dfb-b82d-de8bf44be60d req-d0f5da74-112e-4da6-8d8c-cd21c669f70c service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:30 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Instance destroyed successfully.
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.objects.instance [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lazy-loading 'resources' on Instance uuid 81c8325d-776c-4171-86eb-26f83b7dde00 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=be74d5f7-6805-471f-8295-c60479f28e95,network=Network(629177fb-a069-4ada-a59d-705ad78c6943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe74d5f7-68') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=be74d5f7-6805-471f-8295-c60479f28e95,network=Network(629177fb-a069-4ada-a59d-705ad78c6943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe74d5f7-68') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe74d5f7-68, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-65d1813e-7468-4b8f-b601-919421486512 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-unplugged-65d1813e-7468-4b8f-b601-919421486512 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-65d1813e-7468-4b8f-b601-919421486512 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-65d1813e-7468-4b8f-b601-919421486512 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-65d1813e-7468-4b8f-b601-919421486512 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:30 user nova-compute[75993]: WARNING nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-65d1813e-7468-4b8f-b601-919421486512 for instance with vm_state active and task_state deleting.
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-unplugged-3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-3824792e-3b3f-42e8-88de-ea963abd8625 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:30 user nova-compute[75993]: WARNING nova.compute.manager [req-31367878-8d29-4898-8215-d874120e994f req-22410a15-ed84-47cf-b053-6b2a2ce4afe4 service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-3824792e-3b3f-42e8-88de-ea963abd8625 for instance with vm_state active and task_state deleting.
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad77e68b-6f2c-47ba-8fd9-5c9175a2c672) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: INFO os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:ef:71,bridge_name='br-int',has_traffic_filtering=True,id=be74d5f7-6805-471f-8295-c60479f28e95,network=Network(629177fb-a069-4ada-a59d-705ad78c6943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe74d5f7-68')
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:af:28,bridge_name='br-int',has_traffic_filtering=True,id=973638d8-8c22-4d53-9354-277bb212f9a0,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap973638d8-8c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:af:28,bridge_name='br-int',has_traffic_filtering=True,id=973638d8-8c22-4d53-9354-277bb212f9a0,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap973638d8-8c') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap973638d8-8c, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69f52b4c-992b-4f4d-b541-d2894cf750ea) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: INFO os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:af:28,bridge_name='br-int',has_traffic_filtering=True,id=973638d8-8c22-4d53-9354-277bb212f9a0,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap973638d8-8c')
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=65d1813e-7468-4b8f-b601-919421486512,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65d1813e-74') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=65d1813e-7468-4b8f-b601-919421486512,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65d1813e-74') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65d1813e-74, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29752c8c-dc7a-4a75-8071-19518a213a79) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: INFO os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:ef:8b,bridge_name='br-int',has_traffic_filtering=True,id=65d1813e-7468-4b8f-b601-919421486512,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap65d1813e-74')
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4f:48,bridge_name='br-int',has_traffic_filtering=True,id=73dee529-8844-464d-8f84-9f9abd1f77b3,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dee529-88') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4f:48,bridge_name='br-int',has_traffic_filtering=True,id=73dee529-8844-464d-8f84-9f9abd1f77b3,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dee529-88') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73dee529-88, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d580c252-c3e5-445a-aa51-63e07d54e9f4) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: INFO os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:4f:48,bridge_name='br-int',has_traffic_filtering=True,id=73dee529-8844-464d-8f84-9f9abd1f77b3,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73dee529-88')
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ec:aa,bridge_name='br-int',has_traffic_filtering=True,id=3824792e-3b3f-42e8-88de-ea963abd8625,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3824792e-3b') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ec:aa,bridge_name='br-int',has_traffic_filtering=True,id=3824792e-3b3f-42e8-88de-ea963abd8625,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3824792e-3b') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3824792e-3b, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=53356ba8-6dae-4cea-bb83-9dd37c0a1af2) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: INFO os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:ec:aa,bridge_name='br-int',has_traffic_filtering=True,id=3824792e-3b3f-42e8-88de-ea963abd8625,network=Network(e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3824792e-3b')
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "address": "fa:16:3e:88:3a:ca", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c5e3135-2e", "ovs_interfaceid": "6c5e3135-2e49-4589-8f5c-dd9c75622f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:3a:ca,bridge_name='br-int',has_traffic_filtering=True,id=6c5e3135-2e49-4589-8f5c-dd9c75622f91,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5e3135-2e') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:3a:ca,bridge_name='br-int',has_traffic_filtering=True,id=6c5e3135-2e49-4589-8f5c-dd9c75622f91,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5e3135-2e') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c5e3135-2e, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa65696c-61cc-4907-adec-a52f8bb0e70a) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: INFO os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:3a:ca,bridge_name='br-int',has_traffic_filtering=True,id=6c5e3135-2e49-4589-8f5c-dd9c75622f91,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c5e3135-2e')
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:36:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1214932199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1214932199',id=13,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk/PC/FsP1dgigC6usu3BkxNiG65MVyr+w/h+CCaBkAtjI0jfIMvCBM76ABYWi+yVel9LaEBWnCoNVWvrF8cgT/cyy5Gy7OPLd0zRPZD/feATSXMP+FEy5zWFHl1kdx3w==',key_name='tempest-keypair-1170911457',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a11b5afb90b443f9a283b21bacbc822',ramdisk_id='',reservation_id='r-28906q27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1197599497',owner_user_name='tempest-TaggedBootDevicesTest_v242-1197599497-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:39:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dbe48f7d4a2741eb8c641ff677ef7895',uuid=81c8325d-776c-4171-86eb-26f83b7dde00,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converting VIF {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:e8:3a,bridge_name='br-int',has_traffic_filtering=True,id=d412b0c6-d5b0-4227-a40b-c6747d39448b,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd412b0c6-d5') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e8:3a,bridge_name='br-int',has_traffic_filtering=True,id=d412b0c6-d5b0-4227-a40b-c6747d39448b,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd412b0c6-d5') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd412b0c6-d5, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b9d8164-0f78-44c8-af99-e3a1b58ffb3c) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:31 user nova-compute[75993]: INFO os_vif [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:e8:3a,bridge_name='br-int',has_traffic_filtering=True,id=d412b0c6-d5b0-4227-a40b-c6747d39448b,network=Network(e5d39710-860b-4ee9-8497-961a973073d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd412b0c6-d5')
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'veaQlbNJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:40:31 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5538558a-8fe6-4510-9cdb-87f99b7f463c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:40:31 user nova-compute[75993]: No targets found.
Nov 08 21:40:31 user nova-compute[75993]: iSNS:
Nov 08 21:40:31 user nova-compute[75993]: No targets found.
Nov 08 21:40:31 user nova-compute[75993]: STATIC:
Nov 08 21:40:31 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47
Nov 08 21:40:31 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:31 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:31 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451
Nov 08 21:40:31 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:31 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:31 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5
Nov 08 21:40:31 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:31 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:31 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:40:31 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:31 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:31 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:40:31 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:31 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:31 user nova-compute[75993]: FIRMWARE:
Nov 08 21:40:31 user nova-compute[75993]: No targets found.
Nov 08 21:40:31 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:40:31 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:40:31 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d04c4dc-99c9-4f9e-8489-ee85f62c1ffc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7fa743-2b42-43a3-89c3-5662dac84b4b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:40:31 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:31 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:31 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:31 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:31 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 (non-flash)
Nov 08 21:40:31 user nova-compute[75993]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:31 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:31 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:31 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:31 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544d4f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c7d751-398b-433c-82b7-16ecffcc6cc3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[06013ede-beac-4c6d-8287-7c6188b44c54]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ac0d71-fcfc-43df-8c66-7dc17e077e4b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd71e75-97da-4c49-b9ed-625043e8ca78]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d40f46-9da0-4e5c-b731-7ad9ac604626]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c72a2c-305a-43b2-abcd-a703be32b2f2]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451, portal: 172.16.0.220,3260]
Nov 08 21:40:31 user nova-compute[75993]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451, portal: 172.16.0.220,3260] successful.
Nov 08 21:40:31 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c928c86-706a-45a0-8855-74e227ade451 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[87939eed-7c1c-4ecb-9f9f-708b17f74b4a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] <== disconnect_volume: return (392ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yPjTfreM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:40:31 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a7c65b-b619-4f21-898b-d6b4b8c3f938]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:40:31 user nova-compute[75993]: No targets found.
Nov 08 21:40:31 user nova-compute[75993]: iSNS:
Nov 08 21:40:31 user nova-compute[75993]: No targets found.
Nov 08 21:40:31 user nova-compute[75993]: STATIC:
Nov 08 21:40:31 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47
Nov 08 21:40:31 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:31 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:31 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5
Nov 08 21:40:31 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:31 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:31 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:40:31 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:31 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:31 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:40:31 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:31 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:31 user nova-compute[75993]: FIRMWARE:
Nov 08 21:40:31 user nova-compute[75993]: No targets found.
Nov 08 21:40:31 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:40:31 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:40:31 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:40:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[be58ded0-22b8-453f-94fb-685e00e1d22f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90c7f18-0b69-4ccd-90ef-f5bfc83c3cf4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:32 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:32 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:32 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:32 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 (non-flash)
Nov 08 21:40:32 user nova-compute[75993]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:32 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:32 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:32 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544d4f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5'): ({'sdf'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Removing single pathed devices sdf {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f3437c-f76d-4065-ae12-af538d52b059]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[262db45d-c42e-4410-93aa-d0ea00b431c3]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Flushing IO for device /dev/sdf {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80f173e-e3fd-4741-a629-10970c4b8c68]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-b3d827e4-b6ba-4f8a-943d-fee30972fd13 req-b7ba88d2-081a-4324-8e99-148557110077 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-deleted-bf50bddc-3f74-4d9e-9003-e8075806a131 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:32 user nova-compute[75993]: INFO nova.compute.manager [req-b3d827e4-b6ba-4f8a-943d-fee30972fd13 req-b7ba88d2-081a-4324-8e99-148557110077 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Neutron deleted interface bf50bddc-3f74-4d9e-9003-e8075806a131; detaching it from the instance and deleting it from the info cache
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.network.neutron [req-b3d827e4-b6ba-4f8a-943d-fee30972fd13 req-b7ba88d2-081a-4324-8e99-148557110077 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [{"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "address": "fa:16:3e:3f:86:ab", "network": {"id": "f4303d49-4c87-4f52-8692-365d75a587ec", "bridge": "br-int", "label": "tempest-device-tagging-net2-1836796920", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4197c5a-16", "ovs_interfaceid": "a4197c5a-1660-4d86-97ce-ac19cbc419a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b9243c-f84b-40c1-85d0-4f6b7c4a64c2]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] SCSI volumes sdf have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-b3d827e4-b6ba-4f8a-943d-fee30972fd13 req-b7ba88d2-081a-4324-8e99-148557110077 service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Detach interface failed, port_id=bf50bddc-3f74-4d9e-9003-e8075806a131, reason: Instance f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[97671fe3-db2e-4393-b723-ca5f67f19b50]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe2f935-adb8-4b04-84f3-a076c883d22a]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5, portal: 172.16.0.220,3260]
Nov 08 21:40:32 user nova-compute[75993]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5, portal: 172.16.0.220,3260] successful.
Nov 08 21:40:32 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674908c5-638e-4e6e-ad65-81caac8d2be5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b59e807-33c4-4f52-a403-d2ea9cd438c2]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] <== disconnect_volume: return (366ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YIiOUKgW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:40:32 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5babef96-b8f1-4c74-b7f4-98d27d176f37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:40:32 user nova-compute[75993]: No targets found.
Nov 08 21:40:32 user nova-compute[75993]: iSNS:
Nov 08 21:40:32 user nova-compute[75993]: No targets found.
Nov 08 21:40:32 user nova-compute[75993]: STATIC:
Nov 08 21:40:32 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47
Nov 08 21:40:32 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:32 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:32 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:40:32 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:32 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:32 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:40:32 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:40:32 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:40:32 user nova-compute[75993]: FIRMWARE:
Nov 08 21:40:32 user nova-compute[75993]: No targets found.
Nov 08 21:40:32 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:40:32 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:40:32 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa86ddc4-f219-404c-bd1b-da2d30c8bf7e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4beefb6-0f74-485b-a4b0-f3c230693083]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:32 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:32 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:32 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 (non-flash)
Nov 08 21:40:32 user nova-compute[75993]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:40:32 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:40:32 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544f33c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47'): ({'sdd'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Removing single pathed devices sdd {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea95b537-b811-467d-b75e-46241c785e44]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[846493b4-868c-422d-b764-521407473312]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Flushing IO for device /dev/sdd {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef722a6-af78-4d9a-9e0c-7fd20e101559]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[151aed95-4d17-4fbd-80ea-9a09334c76f1]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] SCSI volumes sdd have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e928e15e-fcad-4198-be97-98e539271ef1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb5c938-bf57-4fa4-aeb2-eb8049547cbd]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47, portal: 172.16.0.220,3260]
Nov 08 21:40:32 user nova-compute[75993]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47, portal: 172.16.0.220,3260] successful.
Nov 08 21:40:32 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a51c11f4-ca9d-41f5-825c-baa074b93b47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef74eca-de7e-4928-9e6b-5b22080d0dd5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] <== disconnect_volume: return (382ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:40:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Deleting instance files /opt/stack/data/nova/instances/81c8325d-776c-4171-86eb-26f83b7dde00_del
Nov 08 21:40:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Deletion of /opt/stack/data/nova/instances/81c8325d-776c-4171-86eb-26f83b7dde00_del complete
Nov 08 21:40:32 user nova-compute[75993]: INFO nova.compute.manager [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Took 4.06 seconds to destroy the instance on the hypervisor.
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:32 user nova-compute[75993]: WARNING nova.compute.manager [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-6c5e3135-2e49-4589-8f5c-dd9c75622f91 for instance with vm_state active and task_state deleting.
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-unplugged-d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-unplugged-d412b0c6-d5b0-4227-a40b-c6747d39448b for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-plugged-d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] Lock "81c8325d-776c-4171-86eb-26f83b7dde00-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] No waiting events found dispatching network-vif-plugged-d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:32 user nova-compute[75993]: WARNING nova.compute.manager [req-45ca7a88-71b2-4a2f-8af3-e079b41ce94f req-71734dce-8442-4f11-87c3-41d8701f4f6e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received unexpected event network-vif-plugged-d412b0c6-d5b0-4227-a40b-c6747d39448b for instance with vm_state active and task_state deleting.
Nov 08 21:40:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-deleted-a4197c5a-1660-4d86-97ce-ac19cbc419a9 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:34 user nova-compute[75993]: INFO nova.compute.manager [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Neutron deleted interface a4197c5a-1660-4d86-97ce-ac19cbc419a9; detaching it from the instance and deleting it from the info cache
Nov 08 21:40:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [{"id": "8061d712-84a3-4484-9af3-7a721ba39201", "address": "fa:16:3e:6f:a0:da", "network": {"id": "decf3cff-055f-4d6b-9784-4cd1aa517767", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1240626397-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8061d712-84", "ovs_interfaceid": "8061d712-84a3-4484-9af3-7a721ba39201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Detach interface failed, port_id=a4197c5a-1660-4d86-97ce-ac19cbc419a9, reason: Instance f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:40:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-deleted-8061d712-84a3-4484-9af3-7a721ba39201 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:34 user nova-compute[75993]: INFO nova.compute.manager [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Neutron deleted interface 8061d712-84a3-4484-9af3-7a721ba39201; detaching it from the instance and deleting it from the info cache
Nov 08 21:40:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [{"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64c7f448-31f1-4983-8137-35563482e00c", "address": "fa:16:3e:f5:1b:26", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c7f448-31", "ovs_interfaceid": "64c7f448-31f1-4983-8137-35563482e00c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Detach interface failed, port_id=8061d712-84a3-4484-9af3-7a721ba39201, reason: Instance f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:40:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-deleted-64c7f448-31f1-4983-8137-35563482e00c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:34 user nova-compute[75993]: INFO nova.compute.manager [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Neutron deleted interface 64c7f448-31f1-4983-8137-35563482e00c; detaching it from the instance and deleting it from the info cache
Nov 08 21:40:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [{"id": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "address": "fa:16:3e:d4:99:3f", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d60025-cd", "ovs_interfaceid": "d4d60025-cd29-4e1d-a98c-d4c6e222914f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03bc5876-9344-412e-b868-0efe6d1a2b87", "address": "fa:16:3e:dd:2d:d9", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03bc5876-93", "ovs_interfaceid": "03bc5876-9344-412e-b868-0efe6d1a2b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "address": "fa:16:3e:10:a5:74", "network": {"id": "541cd4aa-e7f2-4821-be04-b402e722ceff", "bridge": "br-int", "label": "tempest-device-tagging-net1-1110256801", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e1e556b7998d44018428c2753f5d22df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8c4fb3e-98", "ovs_interfaceid": "e8c4fb3e-981c-45b4-9ed3-cea1605128fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-69bd6157-0f86-43ec-a021-0d7d838fb18b req-f3ca3ee0-478e-418f-a99c-f6a33e65b7ab service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Detach interface failed, port_id=64c7f448-31f1-4983-8137-35563482e00c, reason: Instance f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:40:34 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:34 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Took 4.67 seconds to deallocate network for instance.
Nov 08 21:40:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-78eb4cb6-e327-4485-9fd8-c9c480c3cf80 req-ca29d93b-deae-45e7-ab21-24f345eb234e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-deleted-6c5e3135-2e49-4589-8f5c-dd9c75622f91 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:35 user nova-compute[75993]: INFO nova.compute.manager [req-78eb4cb6-e327-4485-9fd8-c9c480c3cf80 req-ca29d93b-deae-45e7-ab21-24f345eb234e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Neutron deleted interface 6c5e3135-2e49-4589-8f5c-dd9c75622f91; detaching it from the instance and deleting it from the info cache
Nov 08 21:40:35 user nova-compute[75993]: DEBUG nova.network.neutron [req-78eb4cb6-e327-4485-9fd8-c9c480c3cf80 req-ca29d93b-deae-45e7-ab21-24f345eb234e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [{"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3824792e-3b3f-42e8-88de-ea963abd8625", "address": "fa:16:3e:c1:ec:aa", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.124", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3824792e-3b", "ovs_interfaceid": "3824792e-3b3f-42e8-88de-ea963abd8625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-78eb4cb6-e327-4485-9fd8-c9c480c3cf80 req-ca29d93b-deae-45e7-ab21-24f345eb234e service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Detach interface failed, port_id=6c5e3135-2e49-4589-8f5c-dd9c75622f91, reason: Instance 81c8325d-776c-4171-86eb-26f83b7dde00 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:40:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-9f38c30c-27a5-4bd4-b9ac-e9f56b343a4d req-6db0a0b7-510f-465a-8140-a2ae101b75ec service nova] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Received event network-vif-deleted-e8c4fb3e-981c-45b4-9ed3-cea1605128fb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:36 user nova-compute[75993]: WARNING nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] While synchronizing instance power states, found 11 instances in the database and 9 instances on the hypervisor.
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid e7d6503c-765f-4652-8865-e6494e6f58d2 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 0965adf7-0f82-4dfa-8d1d-8dafb805a132 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid f0d20870-4544-428f-8963-4e358845514c {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 1299c29d-4c41-43c5-ad63-7eae393065d4 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 9bb5a995-4872-4671-91ab-ca0127d65181 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 81c8325d-776c-4171-86eb-26f83b7dde00 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 96a0b785-b9b9-4d48-880e-e592aedc8c92 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 5a45a70a-a723-43c9-8233-862ea146e6f1 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "adef30df-4254-4133-9db2-4c7708cd1996" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "f0d20870-4544-428f-8963-4e358845514c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "9bb5a995-4872-4671-91ab-ca0127d65181" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "81c8325d-776c-4171-86eb-26f83b7dde00" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "96a0b785-b9b9-4d48-880e-e592aedc8c92" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "5a45a70a-a723-43c9-8233-862ea146e6f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "adef30df-4254-4133-9db2-4c7708cd1996" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "f0d20870-4544-428f-8963-4e358845514c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.179s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.183s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.186s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-deleted-3824792e-3b3f-42e8-88de-ea963abd8625 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:37 user nova-compute[75993]: INFO nova.compute.manager [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Neutron deleted interface 3824792e-3b3f-42e8-88de-ea963abd8625; detaching it from the instance and deleting it from the info cache
Nov 08 21:40:37 user nova-compute[75993]: DEBUG nova.network.neutron [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [{"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "73dee529-8844-464d-8f84-9f9abd1f77b3", "address": "fa:16:3e:a1:4f:48", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.20", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73dee529-88", "ovs_interfaceid": "73dee529-8844-464d-8f84-9f9abd1f77b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Detach interface failed, port_id=3824792e-3b3f-42e8-88de-ea963abd8625, reason: Instance 81c8325d-776c-4171-86eb-26f83b7dde00 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:40:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-deleted-73dee529-8844-464d-8f84-9f9abd1f77b3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:37 user nova-compute[75993]: INFO nova.compute.manager [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Neutron deleted interface 73dee529-8844-464d-8f84-9f9abd1f77b3; detaching it from the instance and deleting it from the info cache
Nov 08 21:40:37 user nova-compute[75993]: DEBUG nova.network.neutron [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [{"id": "be74d5f7-6805-471f-8295-c60479f28e95", "address": "fa:16:3e:1a:ef:71", "network": {"id": "629177fb-a069-4ada-a59d-705ad78c6943", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-350929970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe74d5f7-68", "ovs_interfaceid": "be74d5f7-6805-471f-8295-c60479f28e95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Detach interface failed, port_id=73dee529-8844-464d-8f84-9f9abd1f77b3, reason: Instance 81c8325d-776c-4171-86eb-26f83b7dde00 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:40:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-deleted-be74d5f7-6805-471f-8295-c60479f28e95 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:37 user nova-compute[75993]: INFO nova.compute.manager [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Neutron deleted interface be74d5f7-6805-471f-8295-c60479f28e95; detaching it from the instance and deleting it from the info cache
Nov 08 21:40:37 user nova-compute[75993]: DEBUG nova.network.neutron [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [{"id": "973638d8-8c22-4d53-9354-277bb212f9a0", "address": "fa:16:3e:72:af:28", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.139", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap973638d8-8c", "ovs_interfaceid": "973638d8-8c22-4d53-9354-277bb212f9a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "65d1813e-7468-4b8f-b601-919421486512", "address": "fa:16:3e:41:ef:8b", "network": {"id": "e3f3ecbf-27e6-4f91-994a-5d4f1cfeb887", "bridge": "br-int", "label": "tempest-device-tagging-net1-1895156894", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65d1813e-74", "ovs_interfaceid": "65d1813e-7468-4b8f-b601-919421486512", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "address": "fa:16:3e:db:e8:3a", "network": {"id": "e5d39710-860b-4ee9-8497-961a973073d8", "bridge": "br-int", "label": "tempest-device-tagging-net2-2106148753", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "4a11b5afb90b443f9a283b21bacbc822", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd412b0c6-d5", "ovs_interfaceid": "d412b0c6-d5b0-4227-a40b-c6747d39448b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-b0e1e80b-56c9-4af1-a337-382c0a418e0b req-656da28e-cb43-4277-902e-6d182c0894af service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Detach interface failed, port_id=be74d5f7-6805-471f-8295-c60479f28e95, reason: Instance 81c8325d-776c-4171-86eb-26f83b7dde00 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:40:37 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:37 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Took 5.13 seconds to deallocate network for instance.
Nov 08 21:40:38 user nova-compute[75993]: INFO nova.compute.manager [None req-44dffc89-8fd5-4438-986b-52deadffc74a tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Unrescuing
Nov 08 21:40:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-44dffc89-8fd5-4438-986b-52deadffc74a tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:40:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-44dffc89-8fd5-4438-986b-52deadffc74a tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquired lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:40:38 user nova-compute[75993]: DEBUG nova.network.neutron [None req-44dffc89-8fd5-4438-986b-52deadffc74a tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:40:38 user nova-compute[75993]: INFO nova.compute.manager [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] Took 4.07 seconds to detach 3 volumes for instance.
Nov 08 21:40:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:38 user nova-compute[75993]: DEBUG nova.network.neutron [None req-44dffc89-8fd5-4438-986b-52deadffc74a tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updating instance_info_cache with network_info: [{"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-44dffc89-8fd5-4438-986b-52deadffc74a tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Releasing lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:40:38 user nova-compute[75993]: DEBUG nova.objects.instance [None req-44dffc89-8fd5-4438-986b-52deadffc74a tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'flavor' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:40:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.635s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:39 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Deleted allocations for instance f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ee5bc3f3-7014-4c55-b811-c39c8bbaa42b tempest-TaggedBootDevicesTest-1945801815 tempest-TaggedBootDevicesTest-1945801815-project-member] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.749s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.709s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:39 user nova-compute[75993]: INFO nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "f2c9872b-98ba-48f4-84cc-fbcaa72a8aa1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:39 user nova-compute[75993]: INFO nova.compute.manager [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Terminating instance
Nov 08 21:40:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:40:39 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Instance destroyed successfully.
Nov 08 21:40:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Received event network-vif-deleted-d412b0c6-d5b0-4227-a40b-c6747d39448b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:39 user nova-compute[75993]: WARNING nova.compute.manager [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:40:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:39 user nova-compute[75993]: WARNING nova.compute.manager [req-6ccc4288-e95d-4c07-85d3-51fa0c3cc01f req-37b65529-5a17-471b-9696-33d145d7030d service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:40:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-bfc2cf9d-8c43-4760-80ce-6d8b87d69582 req-ccad36ac-e857-4fa2-85d2-b7c741b5572c service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Received event network-vif-unplugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfc2cf9d-8c43-4760-80ce-6d8b87d69582 req-ccad36ac-e857-4fa2-85d2-b7c741b5572c service nova] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfc2cf9d-8c43-4760-80ce-6d8b87d69582 req-ccad36ac-e857-4fa2-85d2-b7c741b5572c service nova] Lock "f0d20870-4544-428f-8963-4e358845514c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfc2cf9d-8c43-4760-80ce-6d8b87d69582 req-ccad36ac-e857-4fa2-85d2-b7c741b5572c service nova] Lock "f0d20870-4544-428f-8963-4e358845514c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-bfc2cf9d-8c43-4760-80ce-6d8b87d69582 req-ccad36ac-e857-4fa2-85d2-b7c741b5572c service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] No waiting events found dispatching network-vif-unplugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-bfc2cf9d-8c43-4760-80ce-6d8b87d69582 req-ccad36ac-e857-4fa2-85d2-b7c741b5572c service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Received event network-vif-unplugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f0d20870-4544-428f-8963-4e358845514c] Instance destroyed successfully.
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lazy-loading 'resources' on Instance uuid f0d20870-4544-428f-8963-4e358845514c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1322318591',display_name='tempest-TestVolumeSwap-server-1322318591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1322318591',id=6,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA62/w3fHidfeCfzXoIUEExec0aUb25lsXJf1t1kVWE0e+R/ig0XOuLsM49v70Leeze83mDtt2GTlK0xCFeDrulC2shYuJFiz+lZ224goNRPqgrTRz3ED58cdGEKvtfkw==',key_name='tempest-keypair-743530060',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b7b429d0edb493589d12273df3e719c',ramdisk_id='',reservation_id='r-873180es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-825570377',owner_user_name='tempest-TestVolumeSwap-825570377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31bd4afb81724ddfbbbe230ebd7614e0',uuid=f0d20870-4544-428f-8963-4e358845514c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Converting VIF {"id": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "address": "fa:16:3e:94:f8:5d", "network": {"id": "af329001-edb5-4bfc-8135-d6727fa3e5b7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-677556124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b7b429d0edb493589d12273df3e719c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77583e50-36", "ovs_interfaceid": "77583e50-3625-4e95-aaa6-b6b9336e3cd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:f8:5d,bridge_name='br-int',has_traffic_filtering=True,id=77583e50-3625-4e95-aaa6-b6b9336e3cd0,network=Network(af329001-edb5-4bfc-8135-d6727fa3e5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77583e50-36') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG os_vif [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:f8:5d,bridge_name='br-int',has_traffic_filtering=True,id=77583e50-3625-4e95-aaa6-b6b9336e3cd0,network=Network(af329001-edb5-4bfc-8135-d6727fa3e5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77583e50-36') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77583e50-36, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a0948a5-c3b6-4331-9bbf-697bcaba1155) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: INFO os_vif [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:f8:5d,bridge_name='br-int',has_traffic_filtering=True,id=77583e50-3625-4e95-aaa6-b6b9336e3cd0,network=Network(af329001-edb5-4bfc-8135-d6727fa3e5b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77583e50-36')
Nov 08 21:40:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Deleting instance files /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c_del
Nov 08 21:40:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Deletion of /opt/stack/data/nova/instances/f0d20870-4544-428f-8963-4e358845514c_del complete
Nov 08 21:40:41 user nova-compute[75993]: INFO nova.compute.manager [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] [instance: f0d20870-4544-428f-8963-4e358845514c] Took 1.71 seconds to destroy the instance on the hypervisor.
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: f0d20870-4544-428f-8963-4e358845514c] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: f0d20870-4544-428f-8963-4e358845514c] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:41 user nova-compute[75993]: WARNING nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:41 user nova-compute[75993]: WARNING nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:41 user nova-compute[75993]: WARNING nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:41 user nova-compute[75993]: WARNING nova.compute.manager [req-03a0db1d-0b66-43b3-a263-e957a25c44ee req-449306f8-ab35-45e7-8738-6e34f17b4b9a service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:40:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3ecc0e06-fa12-45c9-b262-bc362ff2d2c3 req-a304d60e-af24-42c9-80ea-35ba562feff2 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Received event network-vif-plugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3ecc0e06-fa12-45c9-b262-bc362ff2d2c3 req-a304d60e-af24-42c9-80ea-35ba562feff2 service nova] Acquiring lock "f0d20870-4544-428f-8963-4e358845514c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3ecc0e06-fa12-45c9-b262-bc362ff2d2c3 req-a304d60e-af24-42c9-80ea-35ba562feff2 service nova] Lock "f0d20870-4544-428f-8963-4e358845514c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3ecc0e06-fa12-45c9-b262-bc362ff2d2c3 req-a304d60e-af24-42c9-80ea-35ba562feff2 service nova] Lock "f0d20870-4544-428f-8963-4e358845514c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3ecc0e06-fa12-45c9-b262-bc362ff2d2c3 req-a304d60e-af24-42c9-80ea-35ba562feff2 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] No waiting events found dispatching network-vif-plugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:42 user nova-compute[75993]: WARNING nova.compute.manager [req-3ecc0e06-fa12-45c9-b262-bc362ff2d2c3 req-a304d60e-af24-42c9-80ea-35ba562feff2 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Received unexpected event network-vif-plugged-77583e50-3625-4e95-aaa6-b6b9336e3cd0 for instance with vm_state active and task_state deleting.
Nov 08 21:40:43 user nova-compute[75993]: INFO nova.compute.manager [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] Took 5.83 seconds to detach 3 volumes for instance.
Nov 08 21:40:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:44 user nova-compute[75993]: WARNING nova.compute.manager [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:40:44 user nova-compute[75993]: WARNING nova.compute.manager [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Received event network-vif-deleted-77583e50-3625-4e95-aaa6-b6b9336e3cd0 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:40:44 user nova-compute[75993]: INFO nova.compute.manager [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Neutron deleted interface 77583e50-3625-4e95-aaa6-b6b9336e3cd0; detaching it from the instance and deleting it from the info cache
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: f0d20870-4544-428f-8963-4e358845514c] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:40:44 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: f0d20870-4544-428f-8963-4e358845514c] Took 2.74 seconds to deallocate network for instance.
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-99c87e11-5e2a-4793-8c28-24a87566960f req-2ee7ea7a-1e20-46d5-bbb0-bc7e9ad01c59 service nova] [instance: f0d20870-4544-428f-8963-4e358845514c] Detach interface failed, port_id=77583e50-3625-4e95-aaa6-b6b9336e3cd0, reason: Instance f0d20870-4544-428f-8963-4e358845514c could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:44 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Deleted allocations for instance 81c8325d-776c-4171-86eb-26f83b7dde00
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a4329f4-d400-4bb7-8e15-48477f7390d3 tempest-TaggedBootDevicesTest_v242-1197599497 tempest-TaggedBootDevicesTest_v242-1197599497-project-member] Lock "81c8325d-776c-4171-86eb-26f83b7dde00" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.697s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "81c8325d-776c-4171-86eb-26f83b7dde00" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 7.687s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:44 user nova-compute[75993]: INFO nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 81c8325d-776c-4171-86eb-26f83b7dde00] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "81c8325d-776c-4171-86eb-26f83b7dde00" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-44dffc89-8fd5-4438-986b-52deadffc74a tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:44 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Deleted allocations for instance f0d20870-4544-428f-8963-4e358845514c
Nov 08 21:40:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a5a6d5e7-c969-4cd5-8629-d977d98412c8 tempest-TestVolumeSwap-825570377 tempest-TestVolumeSwap-825570377-project-member] Lock "f0d20870-4544-428f-8963-4e358845514c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.139s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:40:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 21:40:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:53 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:40:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:40:53 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:40:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:40:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:40:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:40:58 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:40:58 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7520MB free_disk=25.391643524169922GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 35ca9fea-481a-42ac-8558-c5140e71de59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1299c29d-4c41-43c5-ad63-7eae393065d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9bb5a995-4872-4671-91ab-ca0127d65181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 96a0b785-b9b9-4d48-880e-e592aedc8c92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 5a45a70a-a723-43c9-8233-862ea146e6f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:40:58 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:40:59 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:40:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.684s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:41:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:41:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:41:00 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:41:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:41:05 user nova-compute[75993]: INFO nova.compute.claims [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Claim successful on node user
Nov 08 21:41:05 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG nova.compute.manager [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG nova.compute.manager [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG nova.network.neutron [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:41:05 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:41:05 user nova-compute[75993]: DEBUG nova.compute.manager [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG nova.policy [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80b800131f464e52a3b4319038d1a23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f53e802f4154acca8aa60dd0961a959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG nova.compute.manager [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:41:05 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Creating image(s)
Nov 08 21:41:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "/opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "/opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "/opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk 1073741824" returned: 0 in 0.062s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Cannot resize image /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Ensure instance console log exists: /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:07 user nova-compute[75993]: DEBUG nova.network.neutron [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Successfully created port: 787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Successfully updated port: 787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquired lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.compute.manager [req-f0bbbb8b-ac25-4156-a6b3-d6c1a866cee1 req-a06c4778-4b12-4f30-8460-9d897d4c7a40 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-changed-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.compute.manager [req-f0bbbb8b-ac25-4156-a6b3-d6c1a866cee1 req-a06c4778-4b12-4f30-8460-9d897d4c7a40 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Refreshing instance network info cache due to event network-changed-787ea6de-4603-481a-8262-d51b1ed365da. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f0bbbb8b-ac25-4156-a6b3-d6c1a866cee1 req-a06c4778-4b12-4f30-8460-9d897d4c7a40 service nova] Acquiring lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance_info_cache with network_info: [{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Releasing lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance network_info: |[{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f0bbbb8b-ac25-4156-a6b3-d6c1a866cee1 req-a06c4778-4b12-4f30-8460-9d897d4c7a40 service nova] Acquired lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.network.neutron [req-f0bbbb8b-ac25-4156-a6b3-d6c1a866cee1 req-a06c4778-4b12-4f30-8460-9d897d4c7a40 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Refreshing network info cache for port 787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Start _get_guest_xml network_info=[{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:41:08 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:41:08 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1114912217',display_name='tempest-ServerActionsTestOtherB-server-1114912217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1114912217',id=16,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGWTKmgE74K9m4nW1Iy7drLyphNyDCWQasfONZutGXOVXbF1PlyC04hFpQCnQRFF8F4wUrmwbqu5NeLi338UFqYkZR8X28Kaoc+ZAStDMMSeZsea49hDL5j+Ud29ai6ZA==',key_name='tempest-keypair-19398814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f53e802f4154acca8aa60dd0961a959',ramdisk_id='',reservation_id='r-5fh0kiuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1900540301',owner_user_name='tempest-ServerActionsTestOtherB-1900540301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:41:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b800131f464e52a3b4319038d1a23a',uuid=f828891c-fc9f-4d73-8467-2fa0a804ffb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converting VIF {"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.objects.instance [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lazy-loading 'pci_devices' on Instance uuid f828891c-fc9f-4d73-8467-2fa0a804ffb0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:41:08 user nova-compute[75993]:   <uuid>f828891c-fc9f-4d73-8467-2fa0a804ffb0</uuid>
Nov 08 21:41:08 user nova-compute[75993]:   <name>instance-00000010</name>
Nov 08 21:41:08 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:41:08 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:41:08 user nova-compute[75993]:   <metadata>
Nov 08 21:41:08 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:41:08 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:41:08 user nova-compute[75993]:       <nova:name>tempest-ServerActionsTestOtherB-server-1114912217</nova:name>
Nov 08 21:41:08 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:41:08</nova:creationTime>
Nov 08 21:41:08 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:41:08 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:41:08 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:41:08 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:41:08 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:41:08 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:41:08 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:41:08 user nova-compute[75993]:       <nova:owner>
Nov 08 21:41:08 user nova-compute[75993]:         <nova:user uuid="80b800131f464e52a3b4319038d1a23a">tempest-ServerActionsTestOtherB-1900540301-project-member</nova:user>
Nov 08 21:41:08 user nova-compute[75993]:         <nova:project uuid="3f53e802f4154acca8aa60dd0961a959">tempest-ServerActionsTestOtherB-1900540301</nova:project>
Nov 08 21:41:08 user nova-compute[75993]:       </nova:owner>
Nov 08 21:41:08 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:41:08 user nova-compute[75993]:       <nova:ports>
Nov 08 21:41:08 user nova-compute[75993]:         <nova:port uuid="787ea6de-4603-481a-8262-d51b1ed365da">
Nov 08 21:41:08 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 21:41:08 user nova-compute[75993]:         </nova:port>
Nov 08 21:41:08 user nova-compute[75993]:       </nova:ports>
Nov 08 21:41:08 user nova-compute[75993]:     </nova:instance>
Nov 08 21:41:08 user nova-compute[75993]:   </metadata>
Nov 08 21:41:08 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:41:08 user nova-compute[75993]:     <system>
Nov 08 21:41:08 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:41:08 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:41:08 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:41:08 user nova-compute[75993]:       <entry name="serial">f828891c-fc9f-4d73-8467-2fa0a804ffb0</entry>
Nov 08 21:41:08 user nova-compute[75993]:       <entry name="uuid">f828891c-fc9f-4d73-8467-2fa0a804ffb0</entry>
Nov 08 21:41:08 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:41:08 user nova-compute[75993]:     </system>
Nov 08 21:41:08 user nova-compute[75993]:   </sysinfo>
Nov 08 21:41:08 user nova-compute[75993]:   <os>
Nov 08 21:41:08 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:41:08 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:41:08 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:41:08 user nova-compute[75993]:   </os>
Nov 08 21:41:08 user nova-compute[75993]:   <features>
Nov 08 21:41:08 user nova-compute[75993]:     <acpi/>
Nov 08 21:41:08 user nova-compute[75993]:     <apic/>
Nov 08 21:41:08 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:41:08 user nova-compute[75993]:   </features>
Nov 08 21:41:08 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:41:08 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:41:08 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:41:08 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:41:08 user nova-compute[75993]:   </clock>
Nov 08 21:41:08 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:41:08 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:41:08 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:41:08 user nova-compute[75993]:   </cpu>
Nov 08 21:41:08 user nova-compute[75993]:   <devices>
Nov 08 21:41:08 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:41:08 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:41:08 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk"/>
Nov 08 21:41:08 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:41:08 user nova-compute[75993]:     </disk>
Nov 08 21:41:08 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:41:08 user nova-compute[75993]:       <mac address="fa:16:3e:ed:c9:e3"/>
Nov 08 21:41:08 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:41:08 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:41:08 user nova-compute[75993]:       <target dev="tap787ea6de-46"/>
Nov 08 21:41:08 user nova-compute[75993]:     </interface>
Nov 08 21:41:08 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:41:08 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/console.log" append="off"/>
Nov 08 21:41:08 user nova-compute[75993]:     </serial>
Nov 08 21:41:08 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:41:08 user nova-compute[75993]:     <video>
Nov 08 21:41:08 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:41:08 user nova-compute[75993]:     </video>
Nov 08 21:41:08 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:41:08 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:41:08 user nova-compute[75993]:     </rng>
Nov 08 21:41:08 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:41:08 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:41:08 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:41:08 user nova-compute[75993]:     </memballoon>
Nov 08 21:41:08 user nova-compute[75993]:   </devices>
Nov 08 21:41:08 user nova-compute[75993]: </domain>
Nov 08 21:41:08 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1114912217',display_name='tempest-ServerActionsTestOtherB-server-1114912217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1114912217',id=16,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGWTKmgE74K9m4nW1Iy7drLyphNyDCWQasfONZutGXOVXbF1PlyC04hFpQCnQRFF8F4wUrmwbqu5NeLi338UFqYkZR8X28Kaoc+ZAStDMMSeZsea49hDL5j+Ud29ai6ZA==',key_name='tempest-keypair-19398814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3f53e802f4154acca8aa60dd0961a959',ramdisk_id='',reservation_id='r-5fh0kiuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1900540301',owner_user_name='tempest-ServerActionsTestOtherB-1900540301-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:41:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b800131f464e52a3b4319038d1a23a',uuid=f828891c-fc9f-4d73-8467-2fa0a804ffb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converting VIF {"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG os_vif [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67636169-554c-564b-8308-221a0647e372', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap787ea6de-46, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap787ea6de-46, col_values=(('qos', UUID('08060551-c097-47a9-99bf-89a8ba8888b4')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap787ea6de-46, col_values=(('external_ids', {'iface-id': '787ea6de-4603-481a-8262-d51b1ed365da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:c9:e3', 'vm-uuid': 'f828891c-fc9f-4d73-8467-2fa0a804ffb0'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:08 user nova-compute[75993]: INFO os_vif [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46')
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:41:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] No VIF found with MAC fa:16:3e:ed:c9:e3, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:41:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:09 user nova-compute[75993]: DEBUG nova.network.neutron [req-f0bbbb8b-ac25-4156-a6b3-d6c1a866cee1 req-a06c4778-4b12-4f30-8460-9d897d4c7a40 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updated VIF entry in instance network info cache for port 787ea6de-4603-481a-8262-d51b1ed365da. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:41:09 user nova-compute[75993]: DEBUG nova.network.neutron [req-f0bbbb8b-ac25-4156-a6b3-d6c1a866cee1 req-a06c4778-4b12-4f30-8460-9d897d4c7a40 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance_info_cache with network_info: [{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:41:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f0bbbb8b-ac25-4156-a6b3-d6c1a866cee1 req-a06c4778-4b12-4f30-8460-9d897d4c7a40 service nova] Releasing lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:41:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:10 user nova-compute[75993]: DEBUG nova.compute.manager [req-54eeca38-5069-4ed4-a196-c0ea38e7dbf6 req-b0b62ada-e818-4523-9720-6020ace39308 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54eeca38-5069-4ed4-a196-c0ea38e7dbf6 req-b0b62ada-e818-4523-9720-6020ace39308 service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54eeca38-5069-4ed4-a196-c0ea38e7dbf6 req-b0b62ada-e818-4523-9720-6020ace39308 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54eeca38-5069-4ed4-a196-c0ea38e7dbf6 req-b0b62ada-e818-4523-9720-6020ace39308 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:10 user nova-compute[75993]: DEBUG nova.compute.manager [req-54eeca38-5069-4ed4-a196-c0ea38e7dbf6 req-b0b62ada-e818-4523-9720-6020ace39308 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:41:10 user nova-compute[75993]: WARNING nova.compute.manager [req-54eeca38-5069-4ed4-a196-c0ea38e7dbf6 req-b0b62ada-e818-4523-9720-6020ace39308 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received unexpected event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with vm_state building and task_state spawning.
Nov 08 21:41:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "48be721e-71fc-488f-b626-54726d7f77b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:41:11 user nova-compute[75993]: INFO nova.compute.claims [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Claim successful on node user
Nov 08 21:41:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:41:11 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 08 21:41:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:41:11 user nova-compute[75993]: DEBUG nova.policy [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '51264b2de70b434893d3a89659e23a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd20a943ee8944e64b996328cf9ee3b27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG nova.compute.manager [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:41:12 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Creating image(s)
Nov 08 21:41:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "/opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "/opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "/opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "e5f1662eb9fd846e3c05fe46c24129a991169d34" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "e5f1662eb9fd846e3c05fe46c24129a991169d34" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34.part --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG nova.network.neutron [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Successfully created port: 70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-fd5526d4-d6a5-43e3-a9e4-70a23da1fb37 req-dbb32d40-3cc9-4513-8ef2-0691541153df service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fd5526d4-d6a5-43e3-a9e4-70a23da1fb37 req-dbb32d40-3cc9-4513-8ef2-0691541153df service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fd5526d4-d6a5-43e3-a9e4-70a23da1fb37 req-dbb32d40-3cc9-4513-8ef2-0691541153df service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fd5526d4-d6a5-43e3-a9e4-70a23da1fb37 req-dbb32d40-3cc9-4513-8ef2-0691541153df service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-fd5526d4-d6a5-43e3-a9e4-70a23da1fb37 req-dbb32d40-3cc9-4513-8ef2-0691541153df service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:41:12 user nova-compute[75993]: WARNING nova.compute.manager [req-fd5526d4-d6a5-43e3-a9e4-70a23da1fb37 req-dbb32d40-3cc9-4513-8ef2-0691541153df service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received unexpected event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with vm_state building and task_state spawning.
Nov 08 21:41:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34.part --force-share --output=json" returned: 0 in 0.294s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.virt.images [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] b94ba2a4-d52b-407d-a8c9-a170800131a7 was qcow2, converting to raw {{(pid=75993) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34.part /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34.converted {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34.part /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34.converted" returned: 0 in 0.207s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34.converted --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.compute.manager [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:41:13 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance spawned successfully.
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34.converted --force-share --output=json" returned: 0 in 0.216s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "e5f1662eb9fd846e3c05fe46c24129a991169d34" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.321s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:13 user nova-compute[75993]: INFO nova.compute.manager [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Took 7.82 seconds to spawn the instance on the hypervisor.
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.compute.manager [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34 --force-share --output=json" returned: 0 in 0.214s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "e5f1662eb9fd846e3c05fe46c24129a991169d34" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "e5f1662eb9fd846e3c05fe46c24129a991169d34" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:13 user nova-compute[75993]: INFO nova.compute.manager [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Took 8.71 seconds to build instance.
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-11fa6ffc-3dd5-4403-9fc5-6cdc9e1f7a59 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.930s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34 --force-share --output=json" returned: 0 in 0.202s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34,backing_fmt=raw /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG nova.network.neutron [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Successfully updated port: 70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34,backing_fmt=raw /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk 1073741824" returned: 0 in 0.085s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "e5f1662eb9fd846e3c05fe46c24129a991169d34" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "refresh_cache-48be721e-71fc-488f-b626-54726d7f77b6" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquired lock "refresh_cache-48be721e-71fc-488f-b626-54726d7f77b6" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.network.neutron [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-ca5a5c05-5d68-4727-a865-f2b12b075393 req-36da2943-b343-4844-b5be-b0f8650ea5c0 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Received event network-changed-70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-ca5a5c05-5d68-4727-a865-f2b12b075393 req-36da2943-b343-4844-b5be-b0f8650ea5c0 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Refreshing instance network info cache due to event network-changed-70c9bef3-cdb6-4b68-9638-e82ab3729f81. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ca5a5c05-5d68-4727-a865-f2b12b075393 req-36da2943-b343-4844-b5be-b0f8650ea5c0 service nova] Acquiring lock "refresh_cache-48be721e-71fc-488f-b626-54726d7f77b6" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.network.neutron [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34 --force-share --output=json" returned: 0 in 0.232s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Checking if we can resize image /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.network.neutron [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Updating instance_info_cache with network_info: [{"id": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "address": "fa:16:3e:e9:c3:86", "network": {"id": "7934fe06-31ea-44d5-81f6-96d6484361e8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2072104424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a943ee8944e64b996328cf9ee3b27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c9bef3-cd", "ovs_interfaceid": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Cannot resize image /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Ensure instance console log exists: /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Releasing lock "refresh_cache-48be721e-71fc-488f-b626-54726d7f77b6" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Instance network_info: |[{"id": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "address": "fa:16:3e:e9:c3:86", "network": {"id": "7934fe06-31ea-44d5-81f6-96d6484361e8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2072104424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a943ee8944e64b996328cf9ee3b27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c9bef3-cd", "ovs_interfaceid": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ca5a5c05-5d68-4727-a865-f2b12b075393 req-36da2943-b343-4844-b5be-b0f8650ea5c0 service nova] Acquired lock "refresh_cache-48be721e-71fc-488f-b626-54726d7f77b6" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.network.neutron [req-ca5a5c05-5d68-4727-a865-f2b12b075393 req-36da2943-b343-4844-b5be-b0f8650ea5c0 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Refreshing network info cache for port 70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Start _get_guest_xml network_info=[{"id": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "address": "fa:16:3e:e9:c3:86", "network": {"id": "7934fe06-31ea-44d5-81f6-96d6484361e8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2072104424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a943ee8944e64b996328cf9ee3b27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c9bef3-cd", "ovs_interfaceid": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:41:06Z,direct_url=<?>,disk_format='qcow2',id=b94ba2a4-d52b-407d-a8c9-a170800131a7,min_disk=0,min_ram=0,name='',owner='f8a487fba6874e0ab5c347e234ffd851',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:41:07Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': 'b94ba2a4-d52b-407d-a8c9-a170800131a7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:41:14 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:41:14 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:41:06Z,direct_url=<?>,disk_format='qcow2',id=b94ba2a4-d52b-407d-a8c9-a170800131a7,min_disk=0,min_ram=0,name='',owner='f8a487fba6874e0ab5c347e234ffd851',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:41:07Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-883682111',display_name='tempest-AttachSCSIVolumeTestJSON-server-883682111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-883682111',id=17,image_ref='b94ba2a4-d52b-407d-a8c9-a170800131a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKSJgEPYIB7xaQKp06bKC50f0LEhZAtsvvdnDiVe2i3lQgBwH4P+Ssxyu4zN0GRP3NSCRrptxRpDGJbWNy33ToqA8vGniZzBcqBwd2QNZIgXj0OheiwlyUPcL/Sv9Guow==',key_name='tempest-keypair-397978473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20a943ee8944e64b996328cf9ee3b27',ramdisk_id='',reservation_id='r-17q0516l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b94ba2a4-d52b-407d-a8c9-a170800131a7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1546388482',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1546388482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:41:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51264b2de70b434893d3a89659e23a4f',uuid=48be721e-71fc-488f-b626-54726d7f77b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "address": "fa:16:3e:e9:c3:86", "network": {"id": "7934fe06-31ea-44d5-81f6-96d6484361e8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2072104424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a943ee8944e64b996328cf9ee3b27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c9bef3-cd", "ovs_interfaceid": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Converting VIF {"id": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "address": "fa:16:3e:e9:c3:86", "network": {"id": "7934fe06-31ea-44d5-81f6-96d6484361e8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2072104424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a943ee8944e64b996328cf9ee3b27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c9bef3-cd", "ovs_interfaceid": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=70c9bef3-cdb6-4b68-9638-e82ab3729f81,network=Network(7934fe06-31ea-44d5-81f6-96d6484361e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c9bef3-cd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.objects.instance [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lazy-loading 'pci_devices' on Instance uuid 48be721e-71fc-488f-b626-54726d7f77b6 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:41:14 user nova-compute[75993]:   <uuid>48be721e-71fc-488f-b626-54726d7f77b6</uuid>
Nov 08 21:41:14 user nova-compute[75993]:   <name>instance-00000011</name>
Nov 08 21:41:14 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:41:14 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:41:14 user nova-compute[75993]:   <metadata>
Nov 08 21:41:14 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:41:14 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:41:14 user nova-compute[75993]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-883682111</nova:name>
Nov 08 21:41:14 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:41:14</nova:creationTime>
Nov 08 21:41:14 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:41:14 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:41:14 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:41:14 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:41:14 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:41:14 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:41:14 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:41:14 user nova-compute[75993]:       <nova:owner>
Nov 08 21:41:14 user nova-compute[75993]:         <nova:user uuid="51264b2de70b434893d3a89659e23a4f">tempest-AttachSCSIVolumeTestJSON-1546388482-project-member</nova:user>
Nov 08 21:41:14 user nova-compute[75993]:         <nova:project uuid="d20a943ee8944e64b996328cf9ee3b27">tempest-AttachSCSIVolumeTestJSON-1546388482</nova:project>
Nov 08 21:41:14 user nova-compute[75993]:       </nova:owner>
Nov 08 21:41:14 user nova-compute[75993]:       <nova:root type="image" uuid="b94ba2a4-d52b-407d-a8c9-a170800131a7"/>
Nov 08 21:41:14 user nova-compute[75993]:       <nova:ports>
Nov 08 21:41:14 user nova-compute[75993]:         <nova:port uuid="70c9bef3-cdb6-4b68-9638-e82ab3729f81">
Nov 08 21:41:14 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 21:41:14 user nova-compute[75993]:         </nova:port>
Nov 08 21:41:14 user nova-compute[75993]:       </nova:ports>
Nov 08 21:41:14 user nova-compute[75993]:     </nova:instance>
Nov 08 21:41:14 user nova-compute[75993]:   </metadata>
Nov 08 21:41:14 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:41:14 user nova-compute[75993]:     <system>
Nov 08 21:41:14 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:41:14 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:41:14 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:41:14 user nova-compute[75993]:       <entry name="serial">48be721e-71fc-488f-b626-54726d7f77b6</entry>
Nov 08 21:41:14 user nova-compute[75993]:       <entry name="uuid">48be721e-71fc-488f-b626-54726d7f77b6</entry>
Nov 08 21:41:14 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:41:14 user nova-compute[75993]:     </system>
Nov 08 21:41:14 user nova-compute[75993]:   </sysinfo>
Nov 08 21:41:14 user nova-compute[75993]:   <os>
Nov 08 21:41:14 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:41:14 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:41:14 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:41:14 user nova-compute[75993]:   </os>
Nov 08 21:41:14 user nova-compute[75993]:   <features>
Nov 08 21:41:14 user nova-compute[75993]:     <acpi/>
Nov 08 21:41:14 user nova-compute[75993]:     <apic/>
Nov 08 21:41:14 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:41:14 user nova-compute[75993]:   </features>
Nov 08 21:41:14 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:41:14 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:41:14 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:41:14 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:41:14 user nova-compute[75993]:   </clock>
Nov 08 21:41:14 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:41:14 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:41:14 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:41:14 user nova-compute[75993]:   </cpu>
Nov 08 21:41:14 user nova-compute[75993]:   <devices>
Nov 08 21:41:14 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:41:14 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:41:14 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk"/>
Nov 08 21:41:14 user nova-compute[75993]:       <target dev="sda" bus="scsi"/>
Nov 08 21:41:14 user nova-compute[75993]:       <address type="drive" controller="0" unit="0"/>
Nov 08 21:41:14 user nova-compute[75993]:     </disk>
Nov 08 21:41:14 user nova-compute[75993]:     <disk type="file" device="cdrom">
Nov 08 21:41:14 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none"/>
Nov 08 21:41:14 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk.config"/>
Nov 08 21:41:14 user nova-compute[75993]:       <target dev="sdb" bus="scsi"/>
Nov 08 21:41:14 user nova-compute[75993]:       <address type="drive" controller="0" unit="1"/>
Nov 08 21:41:14 user nova-compute[75993]:     </disk>
Nov 08 21:41:14 user nova-compute[75993]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 08 21:41:14 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:41:14 user nova-compute[75993]:       <mac address="fa:16:3e:e9:c3:86"/>
Nov 08 21:41:14 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:41:14 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:41:14 user nova-compute[75993]:       <target dev="tap70c9bef3-cd"/>
Nov 08 21:41:14 user nova-compute[75993]:     </interface>
Nov 08 21:41:14 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:41:14 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/console.log" append="off"/>
Nov 08 21:41:14 user nova-compute[75993]:     </serial>
Nov 08 21:41:14 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:41:14 user nova-compute[75993]:     <video>
Nov 08 21:41:14 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:41:14 user nova-compute[75993]:     </video>
Nov 08 21:41:14 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:41:14 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:41:14 user nova-compute[75993]:     </rng>
Nov 08 21:41:14 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:41:14 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:41:14 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:41:14 user nova-compute[75993]:     </memballoon>
Nov 08 21:41:14 user nova-compute[75993]:   </devices>
Nov 08 21:41:14 user nova-compute[75993]: </domain>
Nov 08 21:41:14 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-883682111',display_name='tempest-AttachSCSIVolumeTestJSON-server-883682111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-883682111',id=17,image_ref='b94ba2a4-d52b-407d-a8c9-a170800131a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKSJgEPYIB7xaQKp06bKC50f0LEhZAtsvvdnDiVe2i3lQgBwH4P+Ssxyu4zN0GRP3NSCRrptxRpDGJbWNy33ToqA8vGniZzBcqBwd2QNZIgXj0OheiwlyUPcL/Sv9Guow==',key_name='tempest-keypair-397978473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d20a943ee8944e64b996328cf9ee3b27',ramdisk_id='',reservation_id='r-17q0516l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b94ba2a4-d52b-407d-a8c9-a170800131a7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1546388482',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1546388482-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:41:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51264b2de70b434893d3a89659e23a4f',uuid=48be721e-71fc-488f-b626-54726d7f77b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "address": "fa:16:3e:e9:c3:86", "network": {"id": "7934fe06-31ea-44d5-81f6-96d6484361e8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2072104424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a943ee8944e64b996328cf9ee3b27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c9bef3-cd", "ovs_interfaceid": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Converting VIF {"id": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "address": "fa:16:3e:e9:c3:86", "network": {"id": "7934fe06-31ea-44d5-81f6-96d6484361e8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2072104424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a943ee8944e64b996328cf9ee3b27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c9bef3-cd", "ovs_interfaceid": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=70c9bef3-cdb6-4b68-9638-e82ab3729f81,network=Network(7934fe06-31ea-44d5-81f6-96d6484361e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c9bef3-cd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG os_vif [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=70c9bef3-cdb6-4b68-9638-e82ab3729f81,network=Network(7934fe06-31ea-44d5-81f6-96d6484361e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c9bef3-cd') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a09e892-7dc6-5b4e-a910-7645aac081fe', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70c9bef3-cd, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70c9bef3-cd, col_values=(('qos', UUID('c50c39b7-e147-4e99-aed0-7b6eff6d1139')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70c9bef3-cd, col_values=(('external_ids', {'iface-id': '70c9bef3-cdb6-4b68-9638-e82ab3729f81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:c3:86', 'vm-uuid': '48be721e-71fc-488f-b626-54726d7f77b6'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:14 user nova-compute[75993]: INFO os_vif [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=70c9bef3-cdb6-4b68-9638-e82ab3729f81,network=Network(7934fe06-31ea-44d5-81f6-96d6484361e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c9bef3-cd')
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] No BDM found with device name sda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:41:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] No VIF found with MAC fa:16:3e:e9:c3:86, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:41:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Using config drive
Nov 08 21:41:15 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Creating config drive at /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk.config
Nov 08 21:41:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqmwu_ckg {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqmwu_ckg" returned: 0 in 0.085s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-ca5a5c05-5d68-4727-a865-f2b12b075393 req-36da2943-b343-4844-b5be-b0f8650ea5c0 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Updated VIF entry in instance network info cache for port 70c9bef3-cdb6-4b68-9638-e82ab3729f81. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:41:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-ca5a5c05-5d68-4727-a865-f2b12b075393 req-36da2943-b343-4844-b5be-b0f8650ea5c0 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Updating instance_info_cache with network_info: [{"id": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "address": "fa:16:3e:e9:c3:86", "network": {"id": "7934fe06-31ea-44d5-81f6-96d6484361e8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2072104424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a943ee8944e64b996328cf9ee3b27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c9bef3-cd", "ovs_interfaceid": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:41:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ca5a5c05-5d68-4727-a865-f2b12b075393 req-36da2943-b343-4844-b5be-b0f8650ea5c0 service nova] Releasing lock "refresh_cache-48be721e-71fc-488f-b626-54726d7f77b6" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:41:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:17 user nova-compute[75993]: DEBUG nova.compute.manager [req-00dbc675-97c9-4392-b25c-713d8f2c0b9d req-b58210fe-34e7-4fbf-b036-5894b1bf5f89 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Received event network-vif-plugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-00dbc675-97c9-4392-b25c-713d8f2c0b9d req-b58210fe-34e7-4fbf-b036-5894b1bf5f89 service nova] Acquiring lock "48be721e-71fc-488f-b626-54726d7f77b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-00dbc675-97c9-4392-b25c-713d8f2c0b9d req-b58210fe-34e7-4fbf-b036-5894b1bf5f89 service nova] Lock "48be721e-71fc-488f-b626-54726d7f77b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-00dbc675-97c9-4392-b25c-713d8f2c0b9d req-b58210fe-34e7-4fbf-b036-5894b1bf5f89 service nova] Lock "48be721e-71fc-488f-b626-54726d7f77b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:17 user nova-compute[75993]: DEBUG nova.compute.manager [req-00dbc675-97c9-4392-b25c-713d8f2c0b9d req-b58210fe-34e7-4fbf-b036-5894b1bf5f89 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] No waiting events found dispatching network-vif-plugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:41:17 user nova-compute[75993]: WARNING nova.compute.manager [req-00dbc675-97c9-4392-b25c-713d8f2c0b9d req-b58210fe-34e7-4fbf-b036-5894b1bf5f89 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Received unexpected event network-vif-plugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 for instance with vm_state building and task_state spawning.
Nov 08 21:41:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "96a0b785-b9b9-4d48-880e-e592aedc8c92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:19 user nova-compute[75993]: INFO nova.compute.manager [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Terminating instance
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-5af90427-a4fc-485d-bd74-0f3ab1142c95 req-3f8d1dde-4887-497c-8990-bf2a9940308d service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Received event network-vif-plugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5af90427-a4fc-485d-bd74-0f3ab1142c95 req-3f8d1dde-4887-497c-8990-bf2a9940308d service nova] Acquiring lock "48be721e-71fc-488f-b626-54726d7f77b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5af90427-a4fc-485d-bd74-0f3ab1142c95 req-3f8d1dde-4887-497c-8990-bf2a9940308d service nova] Lock "48be721e-71fc-488f-b626-54726d7f77b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5af90427-a4fc-485d-bd74-0f3ab1142c95 req-3f8d1dde-4887-497c-8990-bf2a9940308d service nova] Lock "48be721e-71fc-488f-b626-54726d7f77b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-5af90427-a4fc-485d-bd74-0f3ab1142c95 req-3f8d1dde-4887-497c-8990-bf2a9940308d service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] No waiting events found dispatching network-vif-plugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:41:19 user nova-compute[75993]: WARNING nova.compute.manager [req-5af90427-a4fc-485d-bd74-0f3ab1142c95 req-3f8d1dde-4887-497c-8990-bf2a9940308d service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Received unexpected event network-vif-plugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 for instance with vm_state building and task_state spawning.
Nov 08 21:41:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-49be3bd7-d948-47d2-98ff-d8c944aa577e req-dbded2bb-f857-4883-a41c-8b3aa72da927 service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Received event network-vif-unplugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-49be3bd7-d948-47d2-98ff-d8c944aa577e req-dbded2bb-f857-4883-a41c-8b3aa72da927 service nova] Acquiring lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-49be3bd7-d948-47d2-98ff-d8c944aa577e req-dbded2bb-f857-4883-a41c-8b3aa72da927 service nova] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-49be3bd7-d948-47d2-98ff-d8c944aa577e req-dbded2bb-f857-4883-a41c-8b3aa72da927 service nova] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-49be3bd7-d948-47d2-98ff-d8c944aa577e req-dbded2bb-f857-4883-a41c-8b3aa72da927 service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] No waiting events found dispatching network-vif-unplugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-49be3bd7-d948-47d2-98ff-d8c944aa577e req-dbded2bb-f857-4883-a41c-8b3aa72da927 service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Received event network-vif-unplugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:41:19 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Instance spawned successfully.
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:41:19 user nova-compute[75993]: INFO nova.compute.manager [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Took 7.82 seconds to spawn the instance on the hypervisor.
Nov 08 21:41:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:41:20 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Instance destroyed successfully.
Nov 08 21:41:20 user nova-compute[75993]: DEBUG nova.objects.instance [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lazy-loading 'resources' on Instance uuid 96a0b785-b9b9-4d48-880e-e592aedc8c92 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-197645581',display_name='tempest-VolumesAdminNegativeTest-server-197645581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-197645581',id=14,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:39:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb3754aebc3a46f2988be1bcf1319aa5',ramdisk_id='',reservation_id='r-afzr0034',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1328949075',owner_user_name='tempest-VolumesAdminNegativeTest-1328949075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:39:15Z,user_data=None,user_id='7c9d198bd0b540b6839c534f99897aed',uuid=96a0b785-b9b9-4d48-880e-e592aedc8c92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "address": "fa:16:3e:e5:86:af", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69eb142-b2", "ovs_interfaceid": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converting VIF {"id": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "address": "fa:16:3e:e5:86:af", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb69eb142-b2", "ovs_interfaceid": "b69eb142-b291-4755-9c1a-265a3c4d7e5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:86:af,bridge_name='br-int',has_traffic_filtering=True,id=b69eb142-b291-4755-9c1a-265a3c4d7e5a,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69eb142-b2') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG os_vif [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:86:af,bridge_name='br-int',has_traffic_filtering=True,id=b69eb142-b291-4755-9c1a-265a3c4d7e5a,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69eb142-b2') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb69eb142-b2, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d813cb5-2b2f-4c88-83e2-1da484306773) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:20 user nova-compute[75993]: INFO os_vif [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:86:af,bridge_name='br-int',has_traffic_filtering=True,id=b69eb142-b291-4755-9c1a-265a3c4d7e5a,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb69eb142-b2')
Nov 08 21:41:20 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Deleting instance files /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92_del
Nov 08 21:41:20 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Deletion of /opt/stack/data/nova/instances/96a0b785-b9b9-4d48-880e-e592aedc8c92_del complete
Nov 08 21:41:20 user nova-compute[75993]: INFO nova.compute.manager [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Took 9.02 seconds to build instance.
Nov 08 21:41:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-268352a3-19e9-49d7-b671-f037c7bfe1be tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.308s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:20 user nova-compute[75993]: INFO nova.compute.manager [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 08 21:41:20 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:20 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:41:21 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Took 0.76 seconds to deallocate network for instance.
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:21 user nova-compute[75993]: INFO nova.compute.manager [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Terminating instance
Nov 08 21:41:21 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:21 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Deleted allocations for instance 96a0b785-b9b9-4d48-880e-e592aedc8c92
Nov 08 21:41:21 user nova-compute[75993]: DEBUG nova.compute.manager [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Received event network-vif-plugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] Acquiring lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG nova.compute.manager [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] No waiting events found dispatching network-vif-plugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:41:21 user nova-compute[75993]: WARNING nova.compute.manager [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Received unexpected event network-vif-plugged-b69eb142-b291-4755-9c1a-265a3c4d7e5a for instance with vm_state deleted and task_state None.
Nov 08 21:41:21 user nova-compute[75993]: DEBUG nova.compute.manager [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] [instance: 96a0b785-b9b9-4d48-880e-e592aedc8c92] Received event network-vif-deleted-b69eb142-b291-4755-9c1a-265a3c4d7e5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG nova.compute.manager [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-unplugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG nova.compute.manager [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-unplugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG nova.compute.manager [req-14edb60b-6704-47f6-b9c3-ab829e756324 req-0c0caaed-c539-4ea1-8252-39a9b62aee64 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-unplugged-39262978-025e-4d08-a52b-4f361719f74a for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-631363e5-1775-40cf-b71e-63a8842d5a14 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "96a0b785-b9b9-4d48-880e-e592aedc8c92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.835s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Instance destroyed successfully.
Nov 08 21:41:22 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lazy-loading 'resources' on Instance uuid 1299c29d-4c41-43c5-ad63-7eae393065d4 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T21:35:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1446269913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1121926887',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtrasof5VVa4N8t9Ec62wXGBSSsbRBbjGULzKVdN0bVvyZ8swMlrLds8d3lYzELTg6JrOJuucCuAAXEYpOoJNoBGe6KIU1HN5gatSV5zcSocuW2xYg9jQETQ50lGSxPmQ==',key_name='tempest-keypair-601691060',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:39:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='586af433a3ee4cc387be213c0d0fca05',ramdisk_id='',reservation_id='r-sk248x4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-553177767',owner_user_name='tempest-ServerActionsV293TestJSON-553177767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c4d6c12e8b64175af3777dbf15ee11e',uuid=1299c29d-4c41-43c5-ad63-7eae393065d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converting VIF {"id": "39262978-025e-4d08-a52b-4f361719f74a", "address": "fa:16:3e:c1:3f:07", "network": {"id": "a2abd0f2-2267-4ca0-b401-2b832cc253d8", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-2024562900-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "586af433a3ee4cc387be213c0d0fca05", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39262978-02", "ovs_interfaceid": "39262978-025e-4d08-a52b-4f361719f74a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_vif [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39262978-02, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af91ace4-14f5-4c41-bdc9-6f66fc3feadd) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:22 user nova-compute[75993]: INFO os_vif [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:3f:07,bridge_name='br-int',has_traffic_filtering=True,id=39262978-025e-4d08-a52b-4f361719f74a,network=Network(a2abd0f2-2267-4ca0-b401-2b832cc253d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39262978-02')
Nov 08 21:41:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQxklKTD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:41:22 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b6472e-1f94-45b5-b029-c7667ab36fff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:41:22 user nova-compute[75993]: No targets found.
Nov 08 21:41:22 user nova-compute[75993]: iSNS:
Nov 08 21:41:22 user nova-compute[75993]: No targets found.
Nov 08 21:41:22 user nova-compute[75993]: STATIC:
Nov 08 21:41:22 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:41:22 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:41:22 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:41:22 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e
Nov 08 21:41:22 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:41:22 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:41:22 user nova-compute[75993]: FIRMWARE:
Nov 08 21:41:22 user nova-compute[75993]: No targets found.
Nov 08 21:41:22 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:41:22 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:41:22 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b43b717-5774-47c7-8113-8e84c405b83a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08f71ab-d55f-44bd-a2f1-c0a9673cfbdd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:41:22 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:41:22 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e (non-flash)
Nov 08 21:41:22 user nova-compute[75993]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:41:22 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f85687c97e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e'): ({'sdk'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Removing single pathed devices sdk {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3779627-aebd-4362-85fe-499b43c7351d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[615f324f-a128-4cda-923d-a351efc5c733]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Flushing IO for device /dev/sdk {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6505d13e-5bce-4b14-80d8-4d6d1d896394]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.051s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f8e90c-7117-4c56-a9f5-89aac17f8758]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] SCSI volumes sdk have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_83a026ce',) {{(pid=86999) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[922efd71-2d0a-4204-8ed5-5aea46e1167d]: (4, None) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff5678-abba-456f-9504-d93a9e47de5a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[13396a41-4ba2-4ed6-b843-0fba97dcb51c]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260]
Nov 08 21:41:22 user nova-compute[75993]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e, portal: 172.16.0.220,3260] successful.
Nov 08 21:41:22 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4af4d21-6fd7-4f91-9cf3-d8e66e91403e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da95de1-45dd-4565-a503-83a19a5bec46]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] <== disconnect_volume: return (396ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:41:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Deleting instance files /opt/stack/data/nova/instances/1299c29d-4c41-43c5-ad63-7eae393065d4_del
Nov 08 21:41:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Deletion of /opt/stack/data/nova/instances/1299c29d-4c41-43c5-ad63-7eae393065d4_del complete
Nov 08 21:41:22 user nova-compute[75993]: INFO nova.compute.manager [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Took 1.49 seconds to destroy the instance on the hypervisor.
Nov 08 21:41:22 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:41:22 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:41:23 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:41:23 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Took 1.09 seconds to deallocate network for instance.
Nov 08 21:41:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-38ecefc9-d411-49be-a392-42d8192ecc54 req-c865f3e0-fcd8-4040-9563-a2ddaac89fe2 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-38ecefc9-d411-49be-a392-42d8192ecc54 req-c865f3e0-fcd8-4040-9563-a2ddaac89fe2 service nova] Acquiring lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-38ecefc9-d411-49be-a392-42d8192ecc54 req-c865f3e0-fcd8-4040-9563-a2ddaac89fe2 service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-38ecefc9-d411-49be-a392-42d8192ecc54 req-c865f3e0-fcd8-4040-9563-a2ddaac89fe2 service nova] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-38ecefc9-d411-49be-a392-42d8192ecc54 req-c865f3e0-fcd8-4040-9563-a2ddaac89fe2 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] No waiting events found dispatching network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:41:23 user nova-compute[75993]: WARNING nova.compute.manager [req-38ecefc9-d411-49be-a392-42d8192ecc54 req-c865f3e0-fcd8-4040-9563-a2ddaac89fe2 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received unexpected event network-vif-plugged-39262978-025e-4d08-a52b-4f361719f74a for instance with vm_state active and task_state deleting.
Nov 08 21:41:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-38ecefc9-d411-49be-a392-42d8192ecc54 req-c865f3e0-fcd8-4040-9563-a2ddaac89fe2 service nova] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Received event network-vif-deleted-39262978-025e-4d08-a52b-4f361719f74a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:24 user nova-compute[75993]: INFO nova.compute.manager [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Took 1.09 seconds to detach 1 volumes for instance.
Nov 08 21:41:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] [instance: 1299c29d-4c41-43c5-ad63-7eae393065d4] Deleting volume: d4af4d21-6fd7-4f91-9cf3-d8e66e91403e {{(pid=75993) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 21:41:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:25 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:41:25 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:41:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:25 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Deleted allocations for instance 1299c29d-4c41-43c5-ad63-7eae393065d4
Nov 08 21:41:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a35273a5-e755-48aa-a1e9-7bacb45e8ecb tempest-ServerActionsV293TestJSON-553177767 tempest-ServerActionsV293TestJSON-553177767-project-member] Lock "1299c29d-4c41-43c5-ad63-7eae393065d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.484s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-804bdb6b-3d32-4aa9-a7d0-938b1e4c8488 req-6db1cf43-890f-4697-afa9-09ef932906d8 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received event network-changed-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-804bdb6b-3d32-4aa9-a7d0-938b1e4c8488 req-6db1cf43-890f-4697-afa9-09ef932906d8 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Refreshing instance network info cache due to event network-changed-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-804bdb6b-3d32-4aa9-a7d0-938b1e4c8488 req-6db1cf43-890f-4697-afa9-09ef932906d8 service nova] Acquiring lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-804bdb6b-3d32-4aa9-a7d0-938b1e4c8488 req-6db1cf43-890f-4697-afa9-09ef932906d8 service nova] Acquired lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG nova.network.neutron [req-804bdb6b-3d32-4aa9-a7d0-938b1e4c8488 req-6db1cf43-890f-4697-afa9-09ef932906d8 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Refreshing network info cache for port d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG nova.network.neutron [req-804bdb6b-3d32-4aa9-a7d0-938b1e4c8488 req-6db1cf43-890f-4697-afa9-09ef932906d8 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Updated VIF entry in instance network info cache for port d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG nova.network.neutron [req-804bdb6b-3d32-4aa9-a7d0-938b1e4c8488 req-6db1cf43-890f-4697-afa9-09ef932906d8 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Updating instance_info_cache with network_info: [{"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-804bdb6b-3d32-4aa9-a7d0-938b1e4c8488 req-6db1cf43-890f-4697-afa9-09ef932906d8 service nova] Releasing lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "5a45a70a-a723-43c9-8233-862ea146e6f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lazy-loading 'flavor' on Instance uuid 5a45a70a-a723-43c9-8233-862ea146e6f1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:41:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "5a45a70a-a723-43c9-8233-862ea146e6f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:30 user nova-compute[75993]: INFO nova.compute.manager [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Attaching volume bb3bbc6d-230b-4edc-832c-414215532ce4 to /dev/vdb
Nov 08 21:41:30 user nova-compute[75993]: DEBUG os_brick.utils [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8936098a-b630-4bbd-9bca-49c86f37a3d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4fff17-fd6b-45ab-a454-8ece043e7971]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b262c3ec-69a8-4674-83a9-accd5d70bc5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[81988380-cd2e-4261-b979-118367e61a8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:41:30 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:41:30 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdd48f4-ea97-4407-ac1b-26730381912d]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG os_brick.utils [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] <== get_connector_properties: return (666ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:41:30 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Updating existing volume attachment record: f2e965f0-c612-41f5-8b86-85ec588a4404 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:41:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:31 user nova-compute[75993]: INFO nova.compute.manager [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Detaching volume e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:41:31 user nova-compute[75993]: INFO nova.virt.block_device [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Attempting to driver detach volume e2ab3823-e622-43bb-8f66-0e85981a3e24 from mountpoint /dev/vdb
Nov 08 21:41:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Attempting to detach device vdb from instance 35ca9fea-481a-42ac-8558-c5140e71de59 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:41:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:41:31 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:41:31 user nova-compute[75993]:   <source dev="/dev/sde"/>
Nov 08 21:41:31 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:41:31 user nova-compute[75993]:   <serial>e2ab3823-e622-43bb-8f66-0e85981a3e24</serial>
Nov 08 21:41:31 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 21:41:31 user nova-compute[75993]: </disk>
Nov 08 21:41:31 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:41:31 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Successfully detached device vdb from instance 35ca9fea-481a-42ac-8558-c5140e71de59 from the persistent domain config.
Nov 08 21:41:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35ca9fea-481a-42ac-8558-c5140e71de59 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:41:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:41:31 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:41:31 user nova-compute[75993]:   <source dev="/dev/sde"/>
Nov 08 21:41:31 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:41:31 user nova-compute[75993]:   <serial>e2ab3823-e622-43bb-8f66-0e85981a3e24</serial>
Nov 08 21:41:31 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 21:41:31 user nova-compute[75993]: </disk>
Nov 08 21:41:31 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:41:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:41:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:41:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:41:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:41:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 21:41:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:41:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:41:51 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:41:51 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updating instance_info_cache with network_info: [{"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:52 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 35ca9fea-481a-42ac-8558-c5140e71de59 is timed out.
Nov 08 21:41:52 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Successfully detached device vdb from instance 35ca9fea-481a-42ac-8558-c5140e71de59 from the live domain config.
Nov 08 21:41:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cOXuFyJH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:41:52 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3025692a-01bd-47c0-9370-744d3e54b897]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:41:52 user nova-compute[75993]: No targets found.
Nov 08 21:41:52 user nova-compute[75993]: iSNS:
Nov 08 21:41:52 user nova-compute[75993]: No targets found.
Nov 08 21:41:52 user nova-compute[75993]: STATIC:
Nov 08 21:41:52 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24
Nov 08 21:41:52 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:41:52 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:41:52 user nova-compute[75993]: FIRMWARE:
Nov 08 21:41:52 user nova-compute[75993]: No targets found.
Nov 08 21:41:52 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:41:52 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:41:52 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1eb611-b509-4eb3-b6b7-e696e6dd2b9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7bd25f-ee28-40bb-9027-d1ba049a1a72]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:41:52 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 (non-flash)
Nov 08 21:41:52 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544f33d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24'): ({'sde'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Removing single pathed devices sde {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1186a2cc-9858-46e2-990f-2b7c520a15f1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a641b1-5e10-42df-82c5-a19617a0ef19]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Flushing IO for device /dev/sde {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d21d337-9453-461b-a94b-2d306ce1fb94]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c41d669-895f-415f-961c-a1372e61ce18]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] SCSI volumes sde have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[262fb160-a96d-4ceb-8abb-d40e1bb775f4]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d279c7-6711-4339-8513-e331816cfa58]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260]
Nov 08 21:41:52 user nova-compute[75993]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24, portal: 172.16.0.220,3260] successful.
Nov 08 21:41:52 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e2ab3823-e622-43bb-8f66-0e85981a3e24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb0c8b0-04ee-460a-8b7f-86dc5a35d2c4]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] <== disconnect_volume: return (303ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:41:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:41:53 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:41:53 user nova-compute[75993]: DEBUG nova.objects.instance [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'flavor' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:41:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-faf3b03d-1120-409f-8f15-d154410ec1e1 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.936s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1587cf0-1100-4d72-b22e-ffbe36b5fbbc tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1587cf0-1100-4d72-b22e-ffbe36b5fbbc tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a1587cf0-1100-4d72-b22e-ffbe36b5fbbc tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a1587cf0-1100-4d72-b22e-ffbe36b5fbbc tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75993) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a1587cf0-1100-4d72-b22e-ffbe36b5fbbc tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'flavor' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG nova.compute.manager [req-1a27aec4-6cfd-4e56-afad-1addc9aacdf1 req-12a654a3-45b5-4a61-9179-7a3f68137efc service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-unplugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a27aec4-6cfd-4e56-afad-1addc9aacdf1 req-12a654a3-45b5-4a61-9179-7a3f68137efc service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a27aec4-6cfd-4e56-afad-1addc9aacdf1 req-12a654a3-45b5-4a61-9179-7a3f68137efc service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a27aec4-6cfd-4e56-afad-1addc9aacdf1 req-12a654a3-45b5-4a61-9179-7a3f68137efc service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG nova.compute.manager [req-1a27aec4-6cfd-4e56-afad-1addc9aacdf1 req-12a654a3-45b5-4a61-9179-7a3f68137efc service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-unplugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:41:55 user nova-compute[75993]: WARNING nova.compute.manager [req-1a27aec4-6cfd-4e56-afad-1addc9aacdf1 req-12a654a3-45b5-4a61-9179-7a3f68137efc service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received unexpected event network-vif-unplugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with vm_state active and task_state powering-off.
Nov 08 21:41:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:55 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance destroyed successfully.
Nov 08 21:41:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a1587cf0-1100-4d72-b22e-ffbe36b5fbbc tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1587cf0-1100-4d72-b22e-ffbe36b5fbbc tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.008s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-4112400c-a459-4cb5-89d4-dac449dd4286 req-67959f0f-ce1d-4d44-9aff-c571e9e9b3d3 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4112400c-a459-4cb5-89d4-dac449dd4286 req-67959f0f-ce1d-4d44-9aff-c571e9e9b3d3 service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4112400c-a459-4cb5-89d4-dac449dd4286 req-67959f0f-ce1d-4d44-9aff-c571e9e9b3d3 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4112400c-a459-4cb5-89d4-dac449dd4286 req-67959f0f-ce1d-4d44-9aff-c571e9e9b3d3 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-4112400c-a459-4cb5-89d4-dac449dd4286 req-67959f0f-ce1d-4d44-9aff-c571e9e9b3d3 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:41:57 user nova-compute[75993]: WARNING nova.compute.manager [req-4112400c-a459-4cb5-89d4-dac449dd4286 req-67959f0f-ce1d-4d44-9aff-c571e9e9b3d3 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received unexpected event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with vm_state stopped and task_state None.
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:41:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:41:59 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:41:59 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7538MB free_disk=25.286617279052734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 35ca9fea-481a-42ac-8558-c5140e71de59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9bb5a995-4872-4671-91ab-ca0127d65181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 5a45a70a-a723-43c9-8233-862ea146e6f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 48be721e-71fc-488f-b626-54726d7f77b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:01 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:42:01 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:42:01 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:42:01 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:42:01 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:42:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtseFdup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:42:08 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:42:08 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:42:08 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c658e2-95e5-4379-8ea1-34f2c66f0e12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:42:08 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[067b3cf9-181c-43c6-8f18-6dfdaeef8efb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4] added
Nov 08 21:42:08 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceab2e0e-e092-4f09-a448-936d707ac9a9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee88d6a0-263d-4b4d-8932-dc7b5814cc56]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XtseFdup {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XtseFdup" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4b315b-7580-46c1-a0fa-093a64c68b82]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XtseFdup'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e2ad26-bcfb-4f6e-a194-7a4f6229e2d3]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a9ec2b-701e-4805-9b87-9277fd5df3f1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 21:42:08 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 21:42:08 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:42:08 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 21:42:08 user nova-compute[75993]: 
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ee2d39-5752-4f1b-88fe-6bd5c09023bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4, portal: 172.16.0.220,3260]
Nov 08 21:42:08 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4, portal: 172.16.0.220,3260] successful.
Nov 08 21:42:08 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.094s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f8d85d-8b2c-4b41-bce5-cff83d42ec82]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4c70b7-ca90-448f-8e11-ef870648ee0a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 (non-flash)
Nov 08 21:42:08 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 (non-flash)
Nov 08 21:42:08 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[277ec330-9ded-43b1-8ca4-3ea305db8d1d]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:42:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtseFdup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:42:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:42:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23766343564363365', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:42:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766343564363365', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:42:09 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lazy-loading 'flavor' on Instance uuid 5a45a70a-a723-43c9-8233-862ea146e6f1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:42:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:42:09 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:42:09 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:42:09 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:42:09 user nova-compute[75993]:   <serial>bb3bbc6d-230b-4edc-832c-414215532ce4</serial>
Nov 08 21:42:09 user nova-compute[75993]: </disk>
Nov 08 21:42:09 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:42:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:42:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:42:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] No VIF found with MAC fa:16:3e:a9:9f:13, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:42:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ca4fde78-5823-4136-b74b-689ea55558c5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.140s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "5a45a70a-a723-43c9-8233-862ea146e6f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:12 user nova-compute[75993]: INFO nova.compute.manager [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Detaching volume bb3bbc6d-230b-4edc-832c-414215532ce4
Nov 08 21:42:12 user nova-compute[75993]: INFO nova.virt.block_device [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Attempting to driver detach volume bb3bbc6d-230b-4edc-832c-414215532ce4 from mountpoint /dev/vdb
Nov 08 21:42:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Attempting to detach device vdb from instance 5a45a70a-a723-43c9-8233-862ea146e6f1 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:42:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:42:12 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:42:12 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:42:12 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:42:12 user nova-compute[75993]:   <serial>bb3bbc6d-230b-4edc-832c-414215532ce4</serial>
Nov 08 21:42:12 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:42:12 user nova-compute[75993]: </disk>
Nov 08 21:42:12 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:42:12 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Successfully detached device vdb from instance 5a45a70a-a723-43c9-8233-862ea146e6f1 from the persistent domain config.
Nov 08 21:42:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a45a70a-a723-43c9-8233-862ea146e6f1 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:42:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:42:12 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:42:12 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:42:12 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:42:12 user nova-compute[75993]:   <serial>bb3bbc6d-230b-4edc-832c-414215532ce4</serial>
Nov 08 21:42:12 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:42:12 user nova-compute[75993]: </disk>
Nov 08 21:42:12 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:42:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a45a70a-a723-43c9-8233-862ea146e6f1 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:42:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:21 user nova-compute[75993]: INFO nova.compute.manager [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Terminating instance
Nov 08 21:42:21 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:42:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-68756cbf-1188-4024-8634-981cf61fb660 req-0d6c2555-6062-4080-814c-bb83646bd58a service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Received event network-vif-unplugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-68756cbf-1188-4024-8634-981cf61fb660 req-0d6c2555-6062-4080-814c-bb83646bd58a service nova] Acquiring lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-68756cbf-1188-4024-8634-981cf61fb660 req-0d6c2555-6062-4080-814c-bb83646bd58a service nova] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-68756cbf-1188-4024-8634-981cf61fb660 req-0d6c2555-6062-4080-814c-bb83646bd58a service nova] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-68756cbf-1188-4024-8634-981cf61fb660 req-0d6c2555-6062-4080-814c-bb83646bd58a service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] No waiting events found dispatching network-vif-unplugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-68756cbf-1188-4024-8634-981cf61fb660 req-0d6c2555-6062-4080-814c-bb83646bd58a service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Received event network-vif-unplugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Instance destroyed successfully.
Nov 08 21:42:22 user nova-compute[75993]: DEBUG nova.objects.instance [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lazy-loading 'resources' on Instance uuid 0965adf7-0f82-4dfa-8d1d-8dafb805a132 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-541923797',display_name='tempest-VolumesAdminNegativeTest-server-541923797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-541923797',id=5,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAUiWjr4KieaILSNGph5j63JcNFT9vhaGUoB1CySUE0bCdDQ5HIvmE+gxwvtLvNtbAvbHULeUm3W0dSR6Qbjt17Th2rTEkU1KyXxyetG8KiKaQo1oFlDrZlcK6gLXS7Ypw==',key_name='tempest-keypair-1614028420',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb3754aebc3a46f2988be1bcf1319aa5',ramdisk_id='',reservation_id='r-za1ab90r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1328949075',owner_user_name='tempest-VolumesAdminNegativeTest-1328949075-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:34:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c9d198bd0b540b6839c534f99897aed',uuid=0965adf7-0f82-4dfa-8d1d-8dafb805a132,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converting VIF {"id": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "address": "fa:16:3e:7d:30:7b", "network": {"id": "c47fba12-441e-46b9-89e3-14f037bb050b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1585391409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb3754aebc3a46f2988be1bcf1319aa5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81a8f9a5-59", "ovs_interfaceid": "81a8f9a5-5955-4ba0-89fb-47a5c3328a3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:30:7b,bridge_name='br-int',has_traffic_filtering=True,id=81a8f9a5-5955-4ba0-89fb-47a5c3328a3b,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a8f9a5-59') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG os_vif [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:30:7b,bridge_name='br-int',has_traffic_filtering=True,id=81a8f9a5-5955-4ba0-89fb-47a5c3328a3b,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a8f9a5-59') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81a8f9a5-59, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b24c2077-8789-4d9b-aa8a-21cc346d430d) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:22 user nova-compute[75993]: INFO os_vif [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:30:7b,bridge_name='br-int',has_traffic_filtering=True,id=81a8f9a5-5955-4ba0-89fb-47a5c3328a3b,network=Network(c47fba12-441e-46b9-89e3-14f037bb050b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81a8f9a5-59')
Nov 08 21:42:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Deleting instance files /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132_del
Nov 08 21:42:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Deletion of /opt/stack/data/nova/instances/0965adf7-0f82-4dfa-8d1d-8dafb805a132_del complete
Nov 08 21:42:22 user nova-compute[75993]: INFO nova.compute.manager [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Took 1.04 seconds to destroy the instance on the hypervisor.
Nov 08 21:42:22 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:42:22 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:42:23 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:42:23 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Took 0.67 seconds to deallocate network for instance.
Nov 08 21:42:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:23 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:42:23 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:42:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:23 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Deleted allocations for instance 0965adf7-0f82-4dfa-8d1d-8dafb805a132
Nov 08 21:42:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c4b198f-9ce2-44dc-a9b2-b44cff7f1a57 tempest-VolumesAdminNegativeTest-1328949075 tempest-VolumesAdminNegativeTest-1328949075-project-member] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.249s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-e60b0119-fb21-4afe-9cf2-5462909e5bff req-7d98f2d2-e805-4741-a989-0ddd7d045975 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Received event network-vif-plugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:42:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e60b0119-fb21-4afe-9cf2-5462909e5bff req-7d98f2d2-e805-4741-a989-0ddd7d045975 service nova] Acquiring lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e60b0119-fb21-4afe-9cf2-5462909e5bff req-7d98f2d2-e805-4741-a989-0ddd7d045975 service nova] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e60b0119-fb21-4afe-9cf2-5462909e5bff req-7d98f2d2-e805-4741-a989-0ddd7d045975 service nova] Lock "0965adf7-0f82-4dfa-8d1d-8dafb805a132-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-e60b0119-fb21-4afe-9cf2-5462909e5bff req-7d98f2d2-e805-4741-a989-0ddd7d045975 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] No waiting events found dispatching network-vif-plugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:42:24 user nova-compute[75993]: WARNING nova.compute.manager [req-e60b0119-fb21-4afe-9cf2-5462909e5bff req-7d98f2d2-e805-4741-a989-0ddd7d045975 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Received unexpected event network-vif-plugged-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b for instance with vm_state deleted and task_state None.
Nov 08 21:42:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-e60b0119-fb21-4afe-9cf2-5462909e5bff req-7d98f2d2-e805-4741-a989-0ddd7d045975 service nova] [instance: 0965adf7-0f82-4dfa-8d1d-8dafb805a132] Received event network-vif-deleted-81a8f9a5-5955-4ba0-89fb-47a5c3328a3b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:42:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:32 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5a45a70a-a723-43c9-8233-862ea146e6f1 is timed out.
Nov 08 21:42:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Successfully detached device vdb from instance 5a45a70a-a723-43c9-8233-862ea146e6f1 from the live domain config.
Nov 08 21:42:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XtseFdup', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:42:32 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9994086c-da0d-4e34-be9a-e8ed85589d5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:42:32 user nova-compute[75993]: No targets found.
Nov 08 21:42:32 user nova-compute[75993]: iSNS:
Nov 08 21:42:32 user nova-compute[75993]: No targets found.
Nov 08 21:42:32 user nova-compute[75993]: STATIC:
Nov 08 21:42:32 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4
Nov 08 21:42:32 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:42:32 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:42:32 user nova-compute[75993]: FIRMWARE:
Nov 08 21:42:32 user nova-compute[75993]: No targets found.
Nov 08 21:42:32 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:42:32 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:42:32 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[df47f748-7241-4a3f-8dbb-84606729445d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[42628f5c-e2a0-4727-b362-0061eb82ca98]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 (non-flash)
Nov 08 21:42:32 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 (non-flash)
Nov 08 21:42:32 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544d61090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[83beead4-ef42-4eda-889c-baf0b2f90a42]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab648c0-9aa0-421f-a2d6-b07532c55a47]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e727cd6-37b2-4c77-b4f3-f6955ec05544]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bde8cc-36da-43e6-8fef-2fa74f8f0c70]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5766f1a5-b2ca-4bd6-9eec-075f346dbda6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[571c286c-f235-4b63-b350-ce28f8a16283]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4, portal: 172.16.0.220,3260]
Nov 08 21:42:32 user nova-compute[75993]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4, portal: 172.16.0.220,3260] successful.
Nov 08 21:42:32 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb3bbc6d-230b-4edc-832c-414215532ce4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[462e9106-e671-4469-a594-845e5e883be6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] <== disconnect_volume: return (361ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:42:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:42:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:35 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lazy-loading 'flavor' on Instance uuid 5a45a70a-a723-43c9-8233-862ea146e6f1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:42:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f0d7feab-4de0-44f7-996d-0c67a2b4fbe5 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.204s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:42:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:45 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:42:45 user nova-compute[75993]: INFO nova.compute.claims [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Claim successful on node user
Nov 08 21:42:46 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG nova.network.neutron [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:42:46 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:42:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:42:46 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Creating image(s)
Nov 08 21:42:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "/opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "/opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.241s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG nova.policy [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78965be8230646288b7fc0443c3f4f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1547c59f8e4d85ad6f650b01243357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk 1073741824" returned: 0 in 0.079s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.217s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Cannot resize image /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Ensure instance console log exists: /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Successfully created port: 0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:42:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:49 user nova-compute[75993]: DEBUG nova.network.neutron [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Successfully updated port: 0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:42:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:42:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquired lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:42:49 user nova-compute[75993]: DEBUG nova.network.neutron [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:42:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-33680495-e960-46ae-8b14-4381a33b17fb req-3e029ed4-fb21-418d-990d-8227e5522eb9 service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Received event network-changed-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:42:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-33680495-e960-46ae-8b14-4381a33b17fb req-3e029ed4-fb21-418d-990d-8227e5522eb9 service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Refreshing instance network info cache due to event network-changed-0885ce8e-2d4b-49fb-891a-3980b0f93ed3. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:42:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33680495-e960-46ae-8b14-4381a33b17fb req-3e029ed4-fb21-418d-990d-8227e5522eb9 service nova] Acquiring lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:42:49 user nova-compute[75993]: DEBUG nova.network.neutron [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.network.neutron [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Updating instance_info_cache with network_info: [{"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Releasing lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Instance network_info: |[{"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33680495-e960-46ae-8b14-4381a33b17fb req-3e029ed4-fb21-418d-990d-8227e5522eb9 service nova] Acquired lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.network.neutron [req-33680495-e960-46ae-8b14-4381a33b17fb req-3e029ed4-fb21-418d-990d-8227e5522eb9 service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Refreshing network info cache for port 0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Start _get_guest_xml network_info=[{"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:42:50 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:42:50 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-176746582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-176746582',id=18,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-fchel5vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:42:47Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=1f2e921c-69cc-496c-9e19-561dcfd00a72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:94,bridge_name='br-int',has_traffic_filtering=True,id=0885ce8e-2d4b-49fb-891a-3980b0f93ed3,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0885ce8e-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.objects.instance [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f2e921c-69cc-496c-9e19-561dcfd00a72 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:42:50 user nova-compute[75993]:   <uuid>1f2e921c-69cc-496c-9e19-561dcfd00a72</uuid>
Nov 08 21:42:50 user nova-compute[75993]:   <name>instance-00000012</name>
Nov 08 21:42:50 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:42:50 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:42:50 user nova-compute[75993]:   <metadata>
Nov 08 21:42:50 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:42:50 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:42:50 user nova-compute[75993]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-176746582</nova:name>
Nov 08 21:42:50 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:42:50</nova:creationTime>
Nov 08 21:42:50 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:42:50 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:42:50 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:42:50 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:42:50 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:42:50 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:42:50 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:42:50 user nova-compute[75993]:       <nova:owner>
Nov 08 21:42:50 user nova-compute[75993]:         <nova:user uuid="78965be8230646288b7fc0443c3f4f6c">tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member</nova:user>
Nov 08 21:42:50 user nova-compute[75993]:         <nova:project uuid="fb1547c59f8e4d85ad6f650b01243357">tempest-ServerBootFromVolumeStableRescueTest-571934265</nova:project>
Nov 08 21:42:50 user nova-compute[75993]:       </nova:owner>
Nov 08 21:42:50 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:42:50 user nova-compute[75993]:       <nova:ports>
Nov 08 21:42:50 user nova-compute[75993]:         <nova:port uuid="0885ce8e-2d4b-49fb-891a-3980b0f93ed3">
Nov 08 21:42:50 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 08 21:42:50 user nova-compute[75993]:         </nova:port>
Nov 08 21:42:50 user nova-compute[75993]:       </nova:ports>
Nov 08 21:42:50 user nova-compute[75993]:     </nova:instance>
Nov 08 21:42:50 user nova-compute[75993]:   </metadata>
Nov 08 21:42:50 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:42:50 user nova-compute[75993]:     <system>
Nov 08 21:42:50 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:42:50 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:42:50 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:42:50 user nova-compute[75993]:       <entry name="serial">1f2e921c-69cc-496c-9e19-561dcfd00a72</entry>
Nov 08 21:42:50 user nova-compute[75993]:       <entry name="uuid">1f2e921c-69cc-496c-9e19-561dcfd00a72</entry>
Nov 08 21:42:50 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:42:50 user nova-compute[75993]:     </system>
Nov 08 21:42:50 user nova-compute[75993]:   </sysinfo>
Nov 08 21:42:50 user nova-compute[75993]:   <os>
Nov 08 21:42:50 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:42:50 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:42:50 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:42:50 user nova-compute[75993]:   </os>
Nov 08 21:42:50 user nova-compute[75993]:   <features>
Nov 08 21:42:50 user nova-compute[75993]:     <acpi/>
Nov 08 21:42:50 user nova-compute[75993]:     <apic/>
Nov 08 21:42:50 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:42:50 user nova-compute[75993]:   </features>
Nov 08 21:42:50 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:42:50 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:42:50 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:42:50 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:42:50 user nova-compute[75993]:   </clock>
Nov 08 21:42:50 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:42:50 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:42:50 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:42:50 user nova-compute[75993]:   </cpu>
Nov 08 21:42:50 user nova-compute[75993]:   <devices>
Nov 08 21:42:50 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:42:50 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:42:50 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk"/>
Nov 08 21:42:50 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:42:50 user nova-compute[75993]:     </disk>
Nov 08 21:42:50 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:42:50 user nova-compute[75993]:       <mac address="fa:16:3e:09:04:94"/>
Nov 08 21:42:50 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:42:50 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:42:50 user nova-compute[75993]:       <target dev="tap0885ce8e-2d"/>
Nov 08 21:42:50 user nova-compute[75993]:     </interface>
Nov 08 21:42:50 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:42:50 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/console.log" append="off"/>
Nov 08 21:42:50 user nova-compute[75993]:     </serial>
Nov 08 21:42:50 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:42:50 user nova-compute[75993]:     <video>
Nov 08 21:42:50 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:42:50 user nova-compute[75993]:     </video>
Nov 08 21:42:50 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:42:50 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:42:50 user nova-compute[75993]:     </rng>
Nov 08 21:42:50 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:42:50 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:42:50 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:42:50 user nova-compute[75993]:     </memballoon>
Nov 08 21:42:50 user nova-compute[75993]:   </devices>
Nov 08 21:42:50 user nova-compute[75993]: </domain>
Nov 08 21:42:50 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-176746582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-176746582',id=18,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-fchel5vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:42:47Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=1f2e921c-69cc-496c-9e19-561dcfd00a72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:94,bridge_name='br-int',has_traffic_filtering=True,id=0885ce8e-2d4b-49fb-891a-3980b0f93ed3,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0885ce8e-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG os_vif [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:94,bridge_name='br-int',has_traffic_filtering=True,id=0885ce8e-2d4b-49fb-891a-3980b0f93ed3,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0885ce8e-2d') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e25130d3-1c78-587f-93b7-3ebf385323cc', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0885ce8e-2d, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0885ce8e-2d, col_values=(('qos', UUID('671aa2a1-e118-487c-b281-6ba4f72ca485')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0885ce8e-2d, col_values=(('external_ids', {'iface-id': '0885ce8e-2d4b-49fb-891a-3980b0f93ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:04:94', 'vm-uuid': '1f2e921c-69cc-496c-9e19-561dcfd00a72'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:50 user nova-compute[75993]: INFO os_vif [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:94,bridge_name='br-int',has_traffic_filtering=True,id=0885ce8e-2d4b-49fb-891a-3980b0f93ed3,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0885ce8e-2d')
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No VIF found with MAC fa:16:3e:09:04:94, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:42:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG nova.network.neutron [req-33680495-e960-46ae-8b14-4381a33b17fb req-3e029ed4-fb21-418d-990d-8227e5522eb9 service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Updated VIF entry in instance network info cache for port 0885ce8e-2d4b-49fb-891a-3980b0f93ed3. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG nova.network.neutron [req-33680495-e960-46ae-8b14-4381a33b17fb req-3e029ed4-fb21-418d-990d-8227e5522eb9 service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Updating instance_info_cache with network_info: [{"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33680495-e960-46ae-8b14-4381a33b17fb req-3e029ed4-fb21-418d-990d-8227e5522eb9 service nova] Releasing lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:42:51 user nova-compute[75993]: INFO nova.compute.claims [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Claim successful on node user
Nov 08 21:42:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:42:51 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:42:52 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:42:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG nova.policy [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37e02c3f49f1467498623a47a979a65d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b3b0aa87ce49949be27025c497a432', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Updating instance_info_cache with network_info: [{"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:42:52 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Creating image(s)
Nov 08 21:42:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.295s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Successfully created port: 11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk 1073741824" returned: 0 in 0.119s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.424s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.213s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:42:53 user nova-compute[75993]: INFO nova.compute.claims [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Claim successful on node user
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Cannot resize image /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Ensure instance console log exists: /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.007s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Successfully updated port: 11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquired lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG nova.compute.manager [req-ecbf47cb-1878-4e3c-8adc-859a8d94a469 req-b493a229-3be5-4612-931b-2450854dbcd6 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-changed-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG nova.compute.manager [req-ecbf47cb-1878-4e3c-8adc-859a8d94a469 req-b493a229-3be5-4612-931b-2450854dbcd6 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Refreshing instance network info cache due to event network-changed-11175b03-1639-4225-a6ab-87b120bf2f3f. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:42:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ecbf47cb-1878-4e3c-8adc-859a8d94a469 req-b493a229-3be5-4612-931b-2450854dbcd6 service nova] Acquiring lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:42:54 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "91fae199-114f-4f67-b48d-1e74ede28d32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.policy [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3248c726b00543bdb2cb218afbf8d803', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd6082215e9b4000909b766f682d4ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updating instance_info_cache with network_info: [{"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Releasing lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Instance network_info: |[{"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ecbf47cb-1878-4e3c-8adc-859a8d94a469 req-b493a229-3be5-4612-931b-2450854dbcd6 service nova] Acquired lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.network.neutron [req-ecbf47cb-1878-4e3c-8adc-859a8d94a469 req-b493a229-3be5-4612-931b-2450854dbcd6 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Refreshing network info cache for port 11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Start _get_guest_xml network_info=[{"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:42:54 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:42:54 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:42:54 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Creating image(s)
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "/opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "/opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-744373370',display_name='tempest-ServerRescueNegativeTestJSON-server-744373370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-744373370',id=19,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfaG+VVz6j6R6G5t7bwcEHBVcu/+dmqNAghC60RUji3tflLGmrnWfYsNyzH+deEaQt/WI6desKUvCG3tX6Gf6/56vWX/mcwYnd9ukQpvl703osps4raWWMOwQOlTKfOew==',key_name='tempest-keypair-807516927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-0qegnfbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:42:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e02c3f49f1467498623a47a979a65d',uuid=b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f9:b5,bridge_name='br-int',has_traffic_filtering=True,id=11175b03-1639-4225-a6ab-87b120bf2f3f,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11175b03-16') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.objects.instance [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'pci_devices' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:42:54 user nova-compute[75993]: INFO nova.compute.claims [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Claim successful on node user
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:42:54 user nova-compute[75993]:   <uuid>b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2</uuid>
Nov 08 21:42:54 user nova-compute[75993]:   <name>instance-00000013</name>
Nov 08 21:42:54 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:42:54 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:42:54 user nova-compute[75993]:   <metadata>
Nov 08 21:42:54 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:42:54 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:42:54 user nova-compute[75993]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-744373370</nova:name>
Nov 08 21:42:54 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:42:54</nova:creationTime>
Nov 08 21:42:54 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:42:54 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:42:54 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:42:54 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:42:54 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:42:54 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:42:54 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:42:54 user nova-compute[75993]:       <nova:owner>
Nov 08 21:42:54 user nova-compute[75993]:         <nova:user uuid="37e02c3f49f1467498623a47a979a65d">tempest-ServerRescueNegativeTestJSON-1699992008-project-member</nova:user>
Nov 08 21:42:54 user nova-compute[75993]:         <nova:project uuid="b1b3b0aa87ce49949be27025c497a432">tempest-ServerRescueNegativeTestJSON-1699992008</nova:project>
Nov 08 21:42:54 user nova-compute[75993]:       </nova:owner>
Nov 08 21:42:54 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:42:54 user nova-compute[75993]:       <nova:ports>
Nov 08 21:42:54 user nova-compute[75993]:         <nova:port uuid="11175b03-1639-4225-a6ab-87b120bf2f3f">
Nov 08 21:42:54 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 21:42:54 user nova-compute[75993]:         </nova:port>
Nov 08 21:42:54 user nova-compute[75993]:       </nova:ports>
Nov 08 21:42:54 user nova-compute[75993]:     </nova:instance>
Nov 08 21:42:54 user nova-compute[75993]:   </metadata>
Nov 08 21:42:54 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:42:54 user nova-compute[75993]:     <system>
Nov 08 21:42:54 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:42:54 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:42:54 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:42:54 user nova-compute[75993]:       <entry name="serial">b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2</entry>
Nov 08 21:42:54 user nova-compute[75993]:       <entry name="uuid">b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2</entry>
Nov 08 21:42:54 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:42:54 user nova-compute[75993]:     </system>
Nov 08 21:42:54 user nova-compute[75993]:   </sysinfo>
Nov 08 21:42:54 user nova-compute[75993]:   <os>
Nov 08 21:42:54 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:42:54 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:42:54 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:42:54 user nova-compute[75993]:   </os>
Nov 08 21:42:54 user nova-compute[75993]:   <features>
Nov 08 21:42:54 user nova-compute[75993]:     <acpi/>
Nov 08 21:42:54 user nova-compute[75993]:     <apic/>
Nov 08 21:42:54 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:42:54 user nova-compute[75993]:   </features>
Nov 08 21:42:54 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:42:54 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:42:54 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:42:54 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:42:54 user nova-compute[75993]:   </clock>
Nov 08 21:42:54 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:42:54 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:42:54 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:42:54 user nova-compute[75993]:   </cpu>
Nov 08 21:42:54 user nova-compute[75993]:   <devices>
Nov 08 21:42:54 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:42:54 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:42:54 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk"/>
Nov 08 21:42:54 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:42:54 user nova-compute[75993]:     </disk>
Nov 08 21:42:54 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:42:54 user nova-compute[75993]:       <mac address="fa:16:3e:ba:f9:b5"/>
Nov 08 21:42:54 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:42:54 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:42:54 user nova-compute[75993]:       <target dev="tap11175b03-16"/>
Nov 08 21:42:54 user nova-compute[75993]:     </interface>
Nov 08 21:42:54 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:42:54 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/console.log" append="off"/>
Nov 08 21:42:54 user nova-compute[75993]:     </serial>
Nov 08 21:42:54 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:42:54 user nova-compute[75993]:     <video>
Nov 08 21:42:54 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:42:54 user nova-compute[75993]:     </video>
Nov 08 21:42:54 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:42:54 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:42:54 user nova-compute[75993]:     </rng>
Nov 08 21:42:54 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:42:54 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:42:54 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:42:54 user nova-compute[75993]:     </memballoon>
Nov 08 21:42:54 user nova-compute[75993]:   </devices>
Nov 08 21:42:54 user nova-compute[75993]: </domain>
Nov 08 21:42:54 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-744373370',display_name='tempest-ServerRescueNegativeTestJSON-server-744373370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-744373370',id=19,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfaG+VVz6j6R6G5t7bwcEHBVcu/+dmqNAghC60RUji3tflLGmrnWfYsNyzH+deEaQt/WI6desKUvCG3tX6Gf6/56vWX/mcwYnd9ukQpvl703osps4raWWMOwQOlTKfOew==',key_name='tempest-keypair-807516927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-0qegnfbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:42:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e02c3f49f1467498623a47a979a65d',uuid=b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f9:b5,bridge_name='br-int',has_traffic_filtering=True,id=11175b03-1639-4225-a6ab-87b120bf2f3f,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11175b03-16') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG os_vif [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f9:b5,bridge_name='br-int',has_traffic_filtering=True,id=11175b03-1639-4225-a6ab-87b120bf2f3f,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11175b03-16') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcc80cbb-9370-5164-ae7b-2f7c9f09dae5', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11175b03-16, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11175b03-16, col_values=(('qos', UUID('0d2b705b-d701-471c-b87f-fc8745713836')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11175b03-16, col_values=(('external_ids', {'iface-id': '11175b03-1639-4225-a6ab-87b120bf2f3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:f9:b5', 'vm-uuid': 'b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:54 user nova-compute[75993]: INFO os_vif [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:f9:b5,bridge_name='br-int',has_traffic_filtering=True,id=11175b03-1639-4225-a6ab-87b120bf2f3f,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11175b03-16')
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.284s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No VIF found with MAC fa:16:3e:ba:f9:b5, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.292s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk 1073741824" returned: 0 in 0.082s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.380s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:42:55 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Instance spawned successfully.
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.247s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.network.neutron [req-ecbf47cb-1878-4e3c-8adc-859a8d94a469 req-b493a229-3be5-4612-931b-2450854dbcd6 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updated VIF entry in instance network info cache for port 11175b03-1639-4225-a6ab-87b120bf2f3f. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.network.neutron [req-ecbf47cb-1878-4e3c-8adc-859a8d94a469 req-b493a229-3be5-4612-931b-2450854dbcd6 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updating instance_info_cache with network_info: [{"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ecbf47cb-1878-4e3c-8adc-859a8d94a469 req-b493a229-3be5-4612-931b-2450854dbcd6 service nova] Releasing lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:42:55 user nova-compute[75993]: INFO nova.compute.manager [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Took 9.05 seconds to spawn the instance on the hypervisor.
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Cannot resize image /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Ensure instance console log exists: /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Successfully created port: 0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.164s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.166s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:55 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:42:55 user nova-compute[75993]: INFO nova.compute.manager [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Took 10.05 seconds to build instance.
Nov 08 21:42:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-21b7957b-a6f1-4226-a8ce-7844ceddc607 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.184s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:42:56 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:42:56 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG nova.policy [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24c7a7bdeeda41339b11c9e9e1ad4c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fc6c404c244ccba1a90b11e5437de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:42:56 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Creating image(s)
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "/opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "/opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "/opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.239s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.235s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk 1073741824" returned: 0 in 0.055s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.232s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-93bcfe6a-638d-4994-aec9-c45a219ea40d req-d263575a-8d1c-4b34-92af-97852ae9a051 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-changed-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-93bcfe6a-638d-4994-aec9-c45a219ea40d req-d263575a-8d1c-4b34-92af-97852ae9a051 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Refreshing instance network info cache due to event network-changed-787ea6de-4603-481a-8262-d51b1ed365da. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-93bcfe6a-638d-4994-aec9-c45a219ea40d req-d263575a-8d1c-4b34-92af-97852ae9a051 service nova] Acquiring lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-93bcfe6a-638d-4994-aec9-c45a219ea40d req-d263575a-8d1c-4b34-92af-97852ae9a051 service nova] Acquired lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG nova.network.neutron [req-93bcfe6a-638d-4994-aec9-c45a219ea40d req-d263575a-8d1c-4b34-92af-97852ae9a051 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Refreshing network info cache for port 787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Cannot resize image /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Ensure instance console log exists: /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.011s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-3724f53d-7f5b-4db1-b05e-8821e83878b4 req-31ca37b6-2c5d-4068-92f0-5eae7a8de152 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3724f53d-7f5b-4db1-b05e-8821e83878b4 req-31ca37b6-2c5d-4068-92f0-5eae7a8de152 service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3724f53d-7f5b-4db1-b05e-8821e83878b4 req-31ca37b6-2c5d-4068-92f0-5eae7a8de152 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3724f53d-7f5b-4db1-b05e-8821e83878b4 req-31ca37b6-2c5d-4068-92f0-5eae7a8de152 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-3724f53d-7f5b-4db1-b05e-8821e83878b4 req-31ca37b6-2c5d-4068-92f0-5eae7a8de152 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:42:57 user nova-compute[75993]: WARNING nova.compute.manager [req-3724f53d-7f5b-4db1-b05e-8821e83878b4 req-31ca37b6-2c5d-4068-92f0-5eae7a8de152 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received unexpected event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with vm_state building and task_state spawning.
Nov 08 21:42:57 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Successfully created port: f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:42:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Successfully updated port: 0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquired lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Successfully updated port: f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-c0d5059b-425c-4c2a-8ad8-3279a756102b req-88569c78-0dd0-4918-ae34-43f26399b3c9 service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Received event network-vif-plugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c0d5059b-425c-4c2a-8ad8-3279a756102b req-88569c78-0dd0-4918-ae34-43f26399b3c9 service nova] Acquiring lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c0d5059b-425c-4c2a-8ad8-3279a756102b req-88569c78-0dd0-4918-ae34-43f26399b3c9 service nova] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c0d5059b-425c-4c2a-8ad8-3279a756102b req-88569c78-0dd0-4918-ae34-43f26399b3c9 service nova] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-c0d5059b-425c-4c2a-8ad8-3279a756102b req-88569c78-0dd0-4918-ae34-43f26399b3c9 service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] No waiting events found dispatching network-vif-plugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:42:58 user nova-compute[75993]: WARNING nova.compute.manager [req-c0d5059b-425c-4c2a-8ad8-3279a756102b req-88569c78-0dd0-4918-ae34-43f26399b3c9 service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Received unexpected event network-vif-plugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 for instance with vm_state active and task_state None.
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquired lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.neutron [req-93bcfe6a-638d-4994-aec9-c45a219ea40d req-d263575a-8d1c-4b34-92af-97852ae9a051 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updated VIF entry in instance network info cache for port 787ea6de-4603-481a-8262-d51b1ed365da. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.neutron [req-93bcfe6a-638d-4994-aec9-c45a219ea40d req-d263575a-8d1c-4b34-92af-97852ae9a051 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance_info_cache with network_info: [{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-93bcfe6a-638d-4994-aec9-c45a219ea40d req-d263575a-8d1c-4b34-92af-97852ae9a051 service nova] Releasing lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updating instance_info_cache with network_info: [{"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.neutron [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updating instance_info_cache with network_info: [{"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Releasing lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Instance network_info: |[{"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Start _get_guest_xml network_info=[{"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Releasing lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Instance network_info: |[{"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Start _get_guest_xml network_info=[{"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-1495f19d-a524-4453-a305-15c631b4d6b9 req-bdf47fad-193d-436a-a984-690d5121b3f7 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-changed-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-1495f19d-a524-4453-a305-15c631b4d6b9 req-bdf47fad-193d-436a-a984-690d5121b3f7 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Refreshing instance network info cache due to event network-changed-f7dc5cf6-90f1-4ec4-9704-49322e9e2179. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1495f19d-a524-4453-a305-15c631b4d6b9 req-bdf47fad-193d-436a-a984-690d5121b3f7 service nova] Acquiring lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1495f19d-a524-4453-a305-15c631b4d6b9 req-bdf47fad-193d-436a-a984-690d5121b3f7 service nova] Acquired lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.neutron [req-1495f19d-a524-4453-a305-15c631b4d6b9 req-bdf47fad-193d-436a-a984-690d5121b3f7 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Refreshing network info cache for port f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:42:59 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:42:59 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:42:59 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:42:59 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1029679479',display_name='tempest-ServerActionsTestOtherA-server-1029679479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1029679479',id=21,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIbQxx7DuVFUAXtivYRWFOk6i/ACW0OwEKdIgB2j1c2VjAAObwQ9qWcNKT6+OGS47GK/q93vubsJMppLLdAeY5qiAyBaCE0GMrdNogpncAZOwVmmfngYFO0ELy5AfYiWQ==',key_name='tempest-keypair-1988537750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-65rjwq2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:42:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=91fae199-114f-4f67-b48d-1e74ede28d32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:34:29,bridge_name='br-int',has_traffic_filtering=True,id=f7dc5cf6-90f1-4ec4-9704-49322e9e2179,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dc5cf6-90') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.objects.instance [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'pci_devices' on Instance uuid 91fae199-114f-4f67-b48d-1e74ede28d32 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2110782090',display_name='tempest-ServerStableDeviceRescueTest-server-2110782090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2110782090',id=20,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMN3lC7vsEkbnadUPTnIr2Jya1/3yi+51p6/n72zhb4uMU3OFUR7/aRNmvgHj88ClY4o03jV8JtlakKqT3cQOcLTpQ4HYKpK1Ff1ZAClAyOauC8xW9s99eqeqsUlkqGrw==',key_name='tempest-keypair-1465265887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd6082215e9b4000909b766f682d4ea1',ramdisk_id='',reservation_id='r-j02wgz8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-370267439',owner_user_name='tempest-ServerStableDeviceRescueTest-370267439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3248c726b00543bdb2cb218afbf8d803',uuid=7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Converting VIF {"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0f:71,bridge_name='br-int',has_traffic_filtering=True,id=0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca,network=Network(8de4945b-2e2b-4b1a-8b14-12dfbe408cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa21b8f-26') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.objects.instance [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:42:59 user nova-compute[75993]:   <uuid>91fae199-114f-4f67-b48d-1e74ede28d32</uuid>
Nov 08 21:42:59 user nova-compute[75993]:   <name>instance-00000015</name>
Nov 08 21:42:59 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:42:59 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:42:59 user nova-compute[75993]:   <metadata>
Nov 08 21:42:59 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:42:59 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:name>tempest-ServerActionsTestOtherA-server-1029679479</nova:name>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:42:59</nova:creationTime>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:42:59 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:42:59 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:owner>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:user uuid="24c7a7bdeeda41339b11c9e9e1ad4c8d">tempest-ServerActionsTestOtherA-1530278199-project-member</nova:user>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:project uuid="696fc6c404c244ccba1a90b11e5437de">tempest-ServerActionsTestOtherA-1530278199</nova:project>
Nov 08 21:42:59 user nova-compute[75993]:       </nova:owner>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:ports>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:port uuid="f7dc5cf6-90f1-4ec4-9704-49322e9e2179">
Nov 08 21:42:59 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 21:42:59 user nova-compute[75993]:         </nova:port>
Nov 08 21:42:59 user nova-compute[75993]:       </nova:ports>
Nov 08 21:42:59 user nova-compute[75993]:     </nova:instance>
Nov 08 21:42:59 user nova-compute[75993]:   </metadata>
Nov 08 21:42:59 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:42:59 user nova-compute[75993]:     <system>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="serial">91fae199-114f-4f67-b48d-1e74ede28d32</entry>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="uuid">91fae199-114f-4f67-b48d-1e74ede28d32</entry>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:42:59 user nova-compute[75993]:     </system>
Nov 08 21:42:59 user nova-compute[75993]:   </sysinfo>
Nov 08 21:42:59 user nova-compute[75993]:   <os>
Nov 08 21:42:59 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:42:59 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:42:59 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:42:59 user nova-compute[75993]:   </os>
Nov 08 21:42:59 user nova-compute[75993]:   <features>
Nov 08 21:42:59 user nova-compute[75993]:     <acpi/>
Nov 08 21:42:59 user nova-compute[75993]:     <apic/>
Nov 08 21:42:59 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:42:59 user nova-compute[75993]:   </features>
Nov 08 21:42:59 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:42:59 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:42:59 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:42:59 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:42:59 user nova-compute[75993]:   </clock>
Nov 08 21:42:59 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:42:59 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:42:59 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:42:59 user nova-compute[75993]:   </cpu>
Nov 08 21:42:59 user nova-compute[75993]:   <devices>
Nov 08 21:42:59 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:42:59 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:42:59 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk"/>
Nov 08 21:42:59 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:42:59 user nova-compute[75993]:     </disk>
Nov 08 21:42:59 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:42:59 user nova-compute[75993]:       <mac address="fa:16:3e:44:34:29"/>
Nov 08 21:42:59 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:42:59 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:42:59 user nova-compute[75993]:       <target dev="tapf7dc5cf6-90"/>
Nov 08 21:42:59 user nova-compute[75993]:     </interface>
Nov 08 21:42:59 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:42:59 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/console.log" append="off"/>
Nov 08 21:42:59 user nova-compute[75993]:     </serial>
Nov 08 21:42:59 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:42:59 user nova-compute[75993]:     <video>
Nov 08 21:42:59 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:42:59 user nova-compute[75993]:     </video>
Nov 08 21:42:59 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:42:59 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:42:59 user nova-compute[75993]:     </rng>
Nov 08 21:42:59 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:42:59 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:42:59 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:42:59 user nova-compute[75993]:     </memballoon>
Nov 08 21:42:59 user nova-compute[75993]:   </devices>
Nov 08 21:42:59 user nova-compute[75993]: </domain>
Nov 08 21:42:59 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1029679479',display_name='tempest-ServerActionsTestOtherA-server-1029679479',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1029679479',id=21,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIbQxx7DuVFUAXtivYRWFOk6i/ACW0OwEKdIgB2j1c2VjAAObwQ9qWcNKT6+OGS47GK/q93vubsJMppLLdAeY5qiAyBaCE0GMrdNogpncAZOwVmmfngYFO0ELy5AfYiWQ==',key_name='tempest-keypair-1988537750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-65rjwq2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:42:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=91fae199-114f-4f67-b48d-1e74ede28d32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:34:29,bridge_name='br-int',has_traffic_filtering=True,id=f7dc5cf6-90f1-4ec4-9704-49322e9e2179,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dc5cf6-90') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG os_vif [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:34:29,bridge_name='br-int',has_traffic_filtering=True,id=f7dc5cf6-90f1-4ec4-9704-49322e9e2179,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dc5cf6-90') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:42:59 user nova-compute[75993]:   <uuid>7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2</uuid>
Nov 08 21:42:59 user nova-compute[75993]:   <name>instance-00000014</name>
Nov 08 21:42:59 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:42:59 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:42:59 user nova-compute[75993]:   <metadata>
Nov 08 21:42:59 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:42:59 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2110782090</nova:name>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:42:59</nova:creationTime>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:42:59 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:42:59 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:owner>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:user uuid="3248c726b00543bdb2cb218afbf8d803">tempest-ServerStableDeviceRescueTest-370267439-project-member</nova:user>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:project uuid="bd6082215e9b4000909b766f682d4ea1">tempest-ServerStableDeviceRescueTest-370267439</nova:project>
Nov 08 21:42:59 user nova-compute[75993]:       </nova:owner>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:42:59 user nova-compute[75993]:       <nova:ports>
Nov 08 21:42:59 user nova-compute[75993]:         <nova:port uuid="0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca">
Nov 08 21:42:59 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 21:42:59 user nova-compute[75993]:         </nova:port>
Nov 08 21:42:59 user nova-compute[75993]:       </nova:ports>
Nov 08 21:42:59 user nova-compute[75993]:     </nova:instance>
Nov 08 21:42:59 user nova-compute[75993]:   </metadata>
Nov 08 21:42:59 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:42:59 user nova-compute[75993]:     <system>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="serial">7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2</entry>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="uuid">7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2</entry>
Nov 08 21:42:59 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:42:59 user nova-compute[75993]:     </system>
Nov 08 21:42:59 user nova-compute[75993]:   </sysinfo>
Nov 08 21:42:59 user nova-compute[75993]:   <os>
Nov 08 21:42:59 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:42:59 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:42:59 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:42:59 user nova-compute[75993]:   </os>
Nov 08 21:42:59 user nova-compute[75993]:   <features>
Nov 08 21:42:59 user nova-compute[75993]:     <acpi/>
Nov 08 21:42:59 user nova-compute[75993]:     <apic/>
Nov 08 21:42:59 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:42:59 user nova-compute[75993]:   </features>
Nov 08 21:42:59 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:42:59 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:42:59 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:42:59 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:42:59 user nova-compute[75993]:   </clock>
Nov 08 21:42:59 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:42:59 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:42:59 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:42:59 user nova-compute[75993]:   </cpu>
Nov 08 21:42:59 user nova-compute[75993]:   <devices>
Nov 08 21:42:59 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:42:59 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:42:59 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk"/>
Nov 08 21:42:59 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:42:59 user nova-compute[75993]:     </disk>
Nov 08 21:42:59 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:42:59 user nova-compute[75993]:       <mac address="fa:16:3e:f2:0f:71"/>
Nov 08 21:42:59 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:42:59 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:42:59 user nova-compute[75993]:       <target dev="tap0fa21b8f-26"/>
Nov 08 21:42:59 user nova-compute[75993]:     </interface>
Nov 08 21:42:59 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:42:59 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/console.log" append="off"/>
Nov 08 21:42:59 user nova-compute[75993]:     </serial>
Nov 08 21:42:59 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:42:59 user nova-compute[75993]:     <video>
Nov 08 21:42:59 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:42:59 user nova-compute[75993]:     </video>
Nov 08 21:42:59 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:42:59 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:42:59 user nova-compute[75993]:     </rng>
Nov 08 21:42:59 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:42:59 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:42:59 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:42:59 user nova-compute[75993]:     </memballoon>
Nov 08 21:42:59 user nova-compute[75993]:   </devices>
Nov 08 21:42:59 user nova-compute[75993]: </domain>
Nov 08 21:42:59 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2110782090',display_name='tempest-ServerStableDeviceRescueTest-server-2110782090',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2110782090',id=20,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMN3lC7vsEkbnadUPTnIr2Jya1/3yi+51p6/n72zhb4uMU3OFUR7/aRNmvgHj88ClY4o03jV8JtlakKqT3cQOcLTpQ4HYKpK1Ff1ZAClAyOauC8xW9s99eqeqsUlkqGrw==',key_name='tempest-keypair-1465265887',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd6082215e9b4000909b766f682d4ea1',ramdisk_id='',reservation_id='r-j02wgz8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-370267439',owner_user_name='tempest-ServerStableDeviceRescueTest-370267439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:42:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3248c726b00543bdb2cb218afbf8d803',uuid=7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Converting VIF {"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0f:71,bridge_name='br-int',has_traffic_filtering=True,id=0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca,network=Network(8de4945b-2e2b-4b1a-8b14-12dfbe408cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa21b8f-26') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG os_vif [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0f:71,bridge_name='br-int',has_traffic_filtering=True,id=0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca,network=Network(8de4945b-2e2b-4b1a-8b14-12dfbe408cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa21b8f-26') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1dfaa3d-9318-50e3-b5b6-a462e3535941', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0369968-6368-5869-ad80-5c869adde65f', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7dc5cf6-90, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7dc5cf6-90, col_values=(('qos', UUID('a5b41eb9-ee30-4ae9-8850-25bacdb05933')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7dc5cf6-90, col_values=(('external_ids', {'iface-id': 'f7dc5cf6-90f1-4ec4-9704-49322e9e2179', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:34:29', 'vm-uuid': '91fae199-114f-4f67-b48d-1e74ede28d32'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: INFO os_vif [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:34:29,bridge_name='br-int',has_traffic_filtering=True,id=f7dc5cf6-90f1-4ec4-9704-49322e9e2179,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dc5cf6-90')
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fa21b8f-26, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0fa21b8f-26, col_values=(('qos', UUID('961940cc-e8d1-4b60-8cce-50c0c7a90d86')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0fa21b8f-26, col_values=(('external_ids', {'iface-id': '0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:0f:71', 'vm-uuid': '7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:42:59 user nova-compute[75993]: INFO os_vif [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:0f:71,bridge_name='br-int',has_traffic_filtering=True,id=0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca,network=Network(8de4945b-2e2b-4b1a-8b14-12dfbe408cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa21b8f-26')
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No VIF found with MAC fa:16:3e:44:34:29, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-changed-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Refreshing instance network info cache due to event network-changed-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] Acquiring lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] Acquired lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.network.neutron [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Refreshing network info cache for port 0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] No VIF found with MAC fa:16:3e:f2:0f:71, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:42:59 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Instance spawned successfully.
Nov 08 21:42:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.network.neutron [req-1495f19d-a524-4453-a305-15c631b4d6b9 req-bdf47fad-193d-436a-a984-690d5121b3f7 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updated VIF entry in instance network info cache for port f7dc5cf6-90f1-4ec4-9704-49322e9e2179. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.network.neutron [req-1495f19d-a524-4453-a305-15c631b4d6b9 req-bdf47fad-193d-436a-a984-690d5121b3f7 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updating instance_info_cache with network_info: [{"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1495f19d-a524-4453-a305-15c631b4d6b9 req-bdf47fad-193d-436a-a984-690d5121b3f7 service nova] Releasing lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:00 user nova-compute[75993]: INFO nova.compute.manager [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Took 7.65 seconds to spawn the instance on the hypervisor.
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:00 user nova-compute[75993]: INFO nova.compute.manager [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Took 8.78 seconds to build instance.
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29534fe0-8173-4bba-b151-4688ba06847d tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.007s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.network.neutron [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updated VIF entry in instance network info cache for port 0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.network.neutron [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updating instance_info_cache with network_info: [{"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] Releasing lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:00 user nova-compute[75993]: WARNING nova.compute.manager [req-1a116b43-c1d4-4fa4-ab6a-278ebe68b3c9 req-5216237e-6061-434b-91b2-414a76b5c425 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received unexpected event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with vm_state building and task_state spawning.
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-9c3d30a6-1dd3-462e-a326-8617ff798540 req-a1aebc7c-d72c-4b3f-871b-52ecfc14142a service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Received event network-vif-plugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9c3d30a6-1dd3-462e-a326-8617ff798540 req-a1aebc7c-d72c-4b3f-871b-52ecfc14142a service nova] Acquiring lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9c3d30a6-1dd3-462e-a326-8617ff798540 req-a1aebc7c-d72c-4b3f-871b-52ecfc14142a service nova] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9c3d30a6-1dd3-462e-a326-8617ff798540 req-a1aebc7c-d72c-4b3f-871b-52ecfc14142a service nova] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-9c3d30a6-1dd3-462e-a326-8617ff798540 req-a1aebc7c-d72c-4b3f-871b-52ecfc14142a service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] No waiting events found dispatching network-vif-plugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:00 user nova-compute[75993]: WARNING nova.compute.manager [req-9c3d30a6-1dd3-462e-a326-8617ff798540 req-a1aebc7c-d72c-4b3f-871b-52ecfc14142a service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Received unexpected event network-vif-plugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 for instance with vm_state active and task_state None.
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.318s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-cc36bfc0-84d6-4467-a159-a4090a7ce59a req-19ab7b16-78ec-4931-84c4-f9ee922b9f92 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Received event network-changed-70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-cc36bfc0-84d6-4467-a159-a4090a7ce59a req-19ab7b16-78ec-4931-84c4-f9ee922b9f92 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Refreshing instance network info cache due to event network-changed-70c9bef3-cdb6-4b68-9638-e82ab3729f81. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cc36bfc0-84d6-4467-a159-a4090a7ce59a req-19ab7b16-78ec-4931-84c4-f9ee922b9f92 service nova] Acquiring lock "refresh_cache-48be721e-71fc-488f-b626-54726d7f77b6" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cc36bfc0-84d6-4467-a159-a4090a7ce59a req-19ab7b16-78ec-4931-84c4-f9ee922b9f92 service nova] Acquired lock "refresh_cache-48be721e-71fc-488f-b626-54726d7f77b6" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG nova.network.neutron [req-cc36bfc0-84d6-4467-a159-a4090a7ce59a req-19ab7b16-78ec-4931-84c4-f9ee922b9f92 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Refreshing network info cache for port 70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.262s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG nova.network.neutron [req-cc36bfc0-84d6-4467-a159-a4090a7ce59a req-19ab7b16-78ec-4931-84c4-f9ee922b9f92 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Updated VIF entry in instance network info cache for port 70c9bef3-cdb6-4b68-9638-e82ab3729f81. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG nova.network.neutron [req-cc36bfc0-84d6-4467-a159-a4090a7ce59a req-19ab7b16-78ec-4931-84c4-f9ee922b9f92 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Updating instance_info_cache with network_info: [{"id": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "address": "fa:16:3e:e9:c3:86", "network": {"id": "7934fe06-31ea-44d5-81f6-96d6484361e8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2072104424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a943ee8944e64b996328cf9ee3b27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c9bef3-cd", "ovs_interfaceid": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cc36bfc0-84d6-4467-a159-a4090a7ce59a req-19ab7b16-78ec-4931-84c4-f9ee922b9f92 service nova] Releasing lock "refresh_cache-48be721e-71fc-488f-b626-54726d7f77b6" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:03 user nova-compute[75993]: DEBUG nova.compute.manager [req-441be076-89f1-4c16-bc3d-ce8d6450be4b req-6c2a801d-8f7d-4f2f-9a98-d03f33c18893 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-441be076-89f1-4c16-bc3d-ce8d6450be4b req-6c2a801d-8f7d-4f2f-9a98-d03f33c18893 service nova] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-441be076-89f1-4c16-bc3d-ce8d6450be4b req-6c2a801d-8f7d-4f2f-9a98-d03f33c18893 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-441be076-89f1-4c16-bc3d-ce8d6450be4b req-6c2a801d-8f7d-4f2f-9a98-d03f33c18893 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:03 user nova-compute[75993]: DEBUG nova.compute.manager [req-441be076-89f1-4c16-bc3d-ce8d6450be4b req-6c2a801d-8f7d-4f2f-9a98-d03f33c18893 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] No waiting events found dispatching network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:03 user nova-compute[75993]: WARNING nova.compute.manager [req-441be076-89f1-4c16-bc3d-ce8d6450be4b req-6c2a801d-8f7d-4f2f-9a98-d03f33c18893 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received unexpected event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 for instance with vm_state building and task_state spawning.
Nov 08 21:43:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json" returned: 0 in 0.370s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-d842389d-ae96-4e2f-9586-f34d1821f426 req-cf9123c0-903a-48d3-8611-4eeed6c20f88 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received event network-changed-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-d842389d-ae96-4e2f-9586-f34d1821f426 req-cf9123c0-903a-48d3-8611-4eeed6c20f88 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Refreshing instance network info cache due to event network-changed-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d842389d-ae96-4e2f-9586-f34d1821f426 req-cf9123c0-903a-48d3-8611-4eeed6c20f88 service nova] Acquiring lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d842389d-ae96-4e2f-9586-f34d1821f426 req-cf9123c0-903a-48d3-8611-4eeed6c20f88 service nova] Acquired lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.network.neutron [req-d842389d-ae96-4e2f-9586-f34d1821f426 req-cf9123c0-903a-48d3-8611-4eeed6c20f88 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Refreshing network info cache for port d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:06 user nova-compute[75993]: WARNING nova.compute.manager [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received unexpected event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with vm_state building and task_state spawning.
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:06 user nova-compute[75993]: WARNING nova.compute.manager [req-f48fad07-dcb0-45b7-bbce-2befd919466b req-109d3d87-6597-4ea3-ae21-9a6828417334 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received unexpected event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with vm_state building and task_state spawning.
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-54cb6622-3a5e-4494-9c70-df0f4700fa75 req-55a76493-4b9a-43e6-bfda-d5b4cbb119f7 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54cb6622-3a5e-4494-9c70-df0f4700fa75 req-55a76493-4b9a-43e6-bfda-d5b4cbb119f7 service nova] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54cb6622-3a5e-4494-9c70-df0f4700fa75 req-55a76493-4b9a-43e6-bfda-d5b4cbb119f7 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54cb6622-3a5e-4494-9c70-df0f4700fa75 req-55a76493-4b9a-43e6-bfda-d5b4cbb119f7 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-54cb6622-3a5e-4494-9c70-df0f4700fa75 req-55a76493-4b9a-43e6-bfda-d5b4cbb119f7 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] No waiting events found dispatching network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:06 user nova-compute[75993]: WARNING nova.compute.manager [req-54cb6622-3a5e-4494-9c70-df0f4700fa75 req-55a76493-4b9a-43e6-bfda-d5b4cbb119f7 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received unexpected event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 for instance with vm_state building and task_state spawning.
Nov 08 21:43:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "5a45a70a-a723-43c9-8233-862ea146e6f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:06 user nova-compute[75993]: INFO nova.compute.manager [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Terminating instance
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.manager [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:43:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Instance spawned successfully.
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:43:06 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:43:06 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7847MB free_disk=25.28164291381836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Instance spawned successfully.
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:07 user nova-compute[75993]: INFO nova.compute.manager [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Took 12.52 seconds to spawn the instance on the hypervisor.
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:07 user nova-compute[75993]: INFO nova.compute.manager [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Took 10.81 seconds to spawn the instance on the hypervisor.
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.manager [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 35ca9fea-481a-42ac-8558-c5140e71de59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9bb5a995-4872-4671-91ab-ca0127d65181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 5a45a70a-a723-43c9-8233-862ea146e6f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 48be721e-71fc-488f-b626-54726d7f77b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:43:07 user nova-compute[75993]: INFO nova.compute.manager [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Took 12.68 seconds to build instance.
Nov 08 21:43:07 user nova-compute[75993]: INFO nova.compute.manager [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Took 13.82 seconds to build instance.
Nov 08 21:43:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-7ca94a0b-b56a-4d7f-be1d-c7a63cbcf60f tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "91fae199-114f-4f67-b48d-1e74ede28d32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.899s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29f3dc68-264a-451c-b89a-ed273d4ec669 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.063s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-8462d014-a8f1-4cc2-9bf6-472e012c2ca8 req-c1017aa3-b565-4b6f-966e-4601ed19542b service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received event network-vif-unplugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8462d014-a8f1-4cc2-9bf6-472e012c2ca8 req-c1017aa3-b565-4b6f-966e-4601ed19542b service nova] Acquiring lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8462d014-a8f1-4cc2-9bf6-472e012c2ca8 req-c1017aa3-b565-4b6f-966e-4601ed19542b service nova] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8462d014-a8f1-4cc2-9bf6-472e012c2ca8 req-c1017aa3-b565-4b6f-966e-4601ed19542b service nova] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-8462d014-a8f1-4cc2-9bf6-472e012c2ca8 req-c1017aa3-b565-4b6f-966e-4601ed19542b service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] No waiting events found dispatching network-vif-unplugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-8462d014-a8f1-4cc2-9bf6-472e012c2ca8 req-c1017aa3-b565-4b6f-966e-4601ed19542b service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received event network-vif-unplugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.network.neutron [req-d842389d-ae96-4e2f-9586-f34d1821f426 req-cf9123c0-903a-48d3-8611-4eeed6c20f88 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Updated VIF entry in instance network info cache for port d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.network.neutron [req-d842389d-ae96-4e2f-9586-f34d1821f426 req-cf9123c0-903a-48d3-8611-4eeed6c20f88 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Updating instance_info_cache with network_info: [{"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d842389d-ae96-4e2f-9586-f34d1821f426 req-cf9123c0-903a-48d3-8611-4eeed6c20f88 service nova] Releasing lock "refresh_cache-5a45a70a-a723-43c9-8233-862ea146e6f1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:43:07 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Instance destroyed successfully.
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.objects.instance [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lazy-loading 'resources' on Instance uuid 5a45a70a-a723-43c9-8233-862ea146e6f1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:39:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-305403190',display_name='tempest-TestStampPattern-server-305403190',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-305403190',id=15,image_ref='93889cb1-4a42-41b5-9227-41c622b05f0f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzi4BBwOWSPcXvNFJcnuunmlc1jVzPYxgIUIXRPn88VowR8XT4JMB17/mhLEw562KI2F8/I3ODTLYr6iRjeOTY7XOCMuEaybFzaDT0RveYsc2TN5uGVN/y+/gl9KBJK0g==',key_name='tempest-TestStampPattern-232827460',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:39:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='872f700d69d8494f9076e7f0d58e14d3',ramdisk_id='',reservation_id='r-ymc2twhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='9bb5a995-4872-4671-91ab-ca0127d65181',image_min_disk='1',image_min_ram='0',image_owner_id='872f700d69d8494f9076e7f0d58e14d3',image_owner_project_name='tempest-TestStampPattern-1350261875',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1350261875-project-member',image_user_id='0ab412f002ec4fe1b978f874d53a2229',owner_project_name='tempest-TestStampPattern-1350261875',owner_user_name='tempest-TestStampPattern-1350261875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:39:48Z,user_data=None,user_id='0ab412f002ec4fe1b978f874d53a2229',uuid=5a45a70a-a723-43c9-8233-862ea146e6f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converting VIF {"id": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "address": "fa:16:3e:a9:9f:13", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3e76079-cf", "ovs_interfaceid": "d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9f:13,bridge_name='br-int',has_traffic_filtering=True,id=d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e76079-cf') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG os_vif [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9f:13,bridge_name='br-int',has_traffic_filtering=True,id=d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e76079-cf') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.005s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3e76079-cf, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfe4588c-698b-4128-90ad-579c8495fda6) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:43:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:07 user nova-compute[75993]: INFO os_vif [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:9f:13,bridge_name='br-int',has_traffic_filtering=True,id=d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3e76079-cf')
Nov 08 21:43:07 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Deleting instance files /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1_del
Nov 08 21:43:07 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Deletion of /opt/stack/data/nova/instances/5a45a70a-a723-43c9-8233-862ea146e6f1_del complete
Nov 08 21:43:08 user nova-compute[75993]: INFO nova.compute.manager [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 08 21:43:08 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG nova.compute.manager [req-4fed1be9-fed7-49ae-b744-42f2610cfe9f req-32404b4f-22f3-4743-877f-283bd387e4da service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received event network-vif-deleted-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:08 user nova-compute[75993]: INFO nova.compute.manager [req-4fed1be9-fed7-49ae-b744-42f2610cfe9f req-32404b4f-22f3-4743-877f-283bd387e4da service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Neutron deleted interface d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a; detaching it from the instance and deleting it from the info cache
Nov 08 21:43:08 user nova-compute[75993]: DEBUG nova.network.neutron [req-4fed1be9-fed7-49ae-b744-42f2610cfe9f req-32404b4f-22f3-4743-877f-283bd387e4da service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:43:08 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Took 0.73 seconds to deallocate network for instance.
Nov 08 21:43:08 user nova-compute[75993]: DEBUG nova.compute.manager [req-4fed1be9-fed7-49ae-b744-42f2610cfe9f req-32404b4f-22f3-4743-877f-283bd387e4da service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Detach interface failed, port_id=d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a, reason: Instance 5a45a70a-a723-43c9-8233-862ea146e6f1 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:43:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:43:09 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:43:09 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:43:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.538s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-0f5e9b54-e44e-42c0-9a3e-f374c1b97d90 req-22961c5b-dfb9-4e2b-add6-34a0f9b12b26 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received event network-vif-plugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0f5e9b54-e44e-42c0-9a3e-f374c1b97d90 req-22961c5b-dfb9-4e2b-add6-34a0f9b12b26 service nova] Acquiring lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0f5e9b54-e44e-42c0-9a3e-f374c1b97d90 req-22961c5b-dfb9-4e2b-add6-34a0f9b12b26 service nova] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0f5e9b54-e44e-42c0-9a3e-f374c1b97d90 req-22961c5b-dfb9-4e2b-add6-34a0f9b12b26 service nova] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-0f5e9b54-e44e-42c0-9a3e-f374c1b97d90 req-22961c5b-dfb9-4e2b-add6-34a0f9b12b26 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] No waiting events found dispatching network-vif-plugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:09 user nova-compute[75993]: WARNING nova.compute.manager [req-0f5e9b54-e44e-42c0-9a3e-f374c1b97d90 req-22961c5b-dfb9-4e2b-add6-34a0f9b12b26 service nova] [instance: 5a45a70a-a723-43c9-8233-862ea146e6f1] Received unexpected event network-vif-plugged-d3e76079-cf26-4fd5-a7c0-1e5d82b3f48a for instance with vm_state deleted and task_state None.
Nov 08 21:43:09 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Deleted allocations for instance 5a45a70a-a723-43c9-8233-862ea146e6f1
Nov 08 21:43:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cbbfcfa7-920f-430e-8eea-61c57c37cf01 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "5a45a70a-a723-43c9-8233-862ea146e6f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.759s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "48be721e-71fc-488f-b626-54726d7f77b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:14 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lazy-loading 'flavor' on Instance uuid 48be721e-71fc-488f-b626-54726d7f77b6 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "48be721e-71fc-488f-b626-54726d7f77b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:15 user nova-compute[75993]: INFO nova.compute.manager [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Attaching volume ad20ab85-eba1-49e1-8e40-d71434f248b1 to /dev/sdc
Nov 08 21:43:15 user nova-compute[75993]: DEBUG os_brick.utils [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[019d0df4-b3a6-4b9b-bc24-7d578b85cc82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[331aa61a-3386-436a-8d8e-b3756b505f80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3875b2f0-74cd-470a-861b-d2ac49b15748]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de811ff-4365-4f42-8bf3-a1d444f3cf24]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:43:15 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:43:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15b4413-667d-45c5-8a35-ca7fb447e6f2]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG os_brick.utils [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Updating existing volume attachment record: 3f981e7b-b072-4810-b268-152c9f3b7fae {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:43:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysEzCdVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:43:45 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:43:45 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:43:45 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5becf2-2981-434b-b189-2e209f35af12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:43:45 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[636ac5c5-1e10-4185-b19d-50d0abf6d093]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1] added
Nov 08 21:43:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fc87da-9306-454d-b4f9-eda29084cdb0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccdd245-c6e9-49fd-838b-3fd9b9c9eecf]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ysEzCdVY {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ysEzCdVY" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[235206e3-9104-431d-b9ef-e599d27e746a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ysEzCdVY'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dfb830d-7eac-4181-b4d2-336deb867313]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[128758be-3613-478b-84b8-9030ad65c65d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 21:43:45 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 21:43:45 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:43:45 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 21:43:45 user nova-compute[75993]: 
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86572b0-5def-476d-bb77-c5b70e88d2ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1, portal: 172.16.0.220,3260]
Nov 08 21:43:45 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1, portal: 172.16.0.220,3260] successful.
Nov 08 21:43:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[06160f69-f026-4b27-9ec9-2b79f409c72a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[81138926-3263-4455-b3c1-4bc7bb8997d7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 (non-flash)
Nov 08 21:43:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 (non-flash)
Nov 08 21:43:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d754c6-7b08-43a4-9466-13102321d24d]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG nova.objects.instance [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'flavor' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquired lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG nova.network.neutron [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG nova.objects.instance [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'info_cache' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:45 user nova-compute[75993]: DEBUG nova.objects.base [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.network.neutron [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updating instance_info_cache with network_info: [{"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Releasing lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysEzCdVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23030363866356361', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030363866356361', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lazy-loading 'flavor' on Instance uuid 48be721e-71fc-488f-b626-54726d7f77b6 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:46 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance destroyed successfully.
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'resources' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.objects.base [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69742388',display_name='tempest-AttachVolumeTestJSON-server-69742388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69742388',id=4,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6oVnaQGjrVAmxsL/HSmftgrrbaB7fw/oPsVgbPjyOcbxzfpKxxWenMze7QWGbAaraNrcOiGtYnTUSvQT2S8k2jlnDmVZFkcsfxNh5h1CEZ87atD5chgSwK78UubB8vnQ==',key_name='tempest-keypair-1705684380',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-ufo08u5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=35ca9fea-481a-42ac-8558-c5140e71de59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG os_vif [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c7b1cf2-c7, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8efd1976-7a03-4bf0-a669-c569fd8d7f5e) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:43:46 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:43:46 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:43:46 user nova-compute[75993]:   <target dev="sdc" bus="scsi"/>
Nov 08 21:43:46 user nova-compute[75993]:   <serial>ad20ab85-eba1-49e1-8e40-d71434f248b1</serial>
Nov 08 21:43:46 user nova-compute[75993]:   <address type="drive" controller="0" unit="2"/>
Nov 08 21:43:46 user nova-compute[75993]: </disk>
Nov 08 21:43:46 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:46 user nova-compute[75993]: INFO os_vif [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7')
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Start _get_guest_xml network_info=[{"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'numa_topology' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.objects.base [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:43:46 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:43:46 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.objects.base [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69742388',display_name='tempest-AttachVolumeTestJSON-server-69742388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69742388',id=4,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6oVnaQGjrVAmxsL/HSmftgrrbaB7fw/oPsVgbPjyOcbxzfpKxxWenMze7QWGbAaraNrcOiGtYnTUSvQT2S8k2jlnDmVZFkcsfxNh5h1CEZ87atD5chgSwK78UubB8vnQ==',key_name='tempest-keypair-1705684380',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-ufo08u5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=35ca9fea-481a-42ac-8558-c5140e71de59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'pci_devices' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.objects.base [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:43:46 user nova-compute[75993]:   <uuid>35ca9fea-481a-42ac-8558-c5140e71de59</uuid>
Nov 08 21:43:46 user nova-compute[75993]:   <name>instance-00000004</name>
Nov 08 21:43:46 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:43:46 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:43:46 user nova-compute[75993]:   <metadata>
Nov 08 21:43:46 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:43:46 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:43:46 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeTestJSON-server-69742388</nova:name>
Nov 08 21:43:46 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:43:46</nova:creationTime>
Nov 08 21:43:46 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:43:46 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:43:46 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:43:46 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:43:46 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:43:46 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:43:46 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:43:46 user nova-compute[75993]:       <nova:owner>
Nov 08 21:43:46 user nova-compute[75993]:         <nova:user uuid="9276d87f95734c47897fba9ea4fe2d94">tempest-AttachVolumeTestJSON-1483084463-project-member</nova:user>
Nov 08 21:43:46 user nova-compute[75993]:         <nova:project uuid="00def573657242f289160a6a74dd8ad3">tempest-AttachVolumeTestJSON-1483084463</nova:project>
Nov 08 21:43:46 user nova-compute[75993]:       </nova:owner>
Nov 08 21:43:46 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:43:46 user nova-compute[75993]:       <nova:ports>
Nov 08 21:43:46 user nova-compute[75993]:         <nova:port uuid="8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2">
Nov 08 21:43:46 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 21:43:46 user nova-compute[75993]:         </nova:port>
Nov 08 21:43:46 user nova-compute[75993]:       </nova:ports>
Nov 08 21:43:46 user nova-compute[75993]:     </nova:instance>
Nov 08 21:43:46 user nova-compute[75993]:   </metadata>
Nov 08 21:43:46 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:43:46 user nova-compute[75993]:     <system>
Nov 08 21:43:46 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:43:46 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:43:46 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:43:46 user nova-compute[75993]:       <entry name="serial">35ca9fea-481a-42ac-8558-c5140e71de59</entry>
Nov 08 21:43:46 user nova-compute[75993]:       <entry name="uuid">35ca9fea-481a-42ac-8558-c5140e71de59</entry>
Nov 08 21:43:46 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:43:46 user nova-compute[75993]:     </system>
Nov 08 21:43:46 user nova-compute[75993]:   </sysinfo>
Nov 08 21:43:46 user nova-compute[75993]:   <os>
Nov 08 21:43:46 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:43:46 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:43:46 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:43:46 user nova-compute[75993]:   </os>
Nov 08 21:43:46 user nova-compute[75993]:   <features>
Nov 08 21:43:46 user nova-compute[75993]:     <acpi/>
Nov 08 21:43:46 user nova-compute[75993]:     <apic/>
Nov 08 21:43:46 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:43:46 user nova-compute[75993]:   </features>
Nov 08 21:43:46 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:43:46 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:43:46 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:43:46 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:43:46 user nova-compute[75993]:   </clock>
Nov 08 21:43:46 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:43:46 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:43:46 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:43:46 user nova-compute[75993]:   </cpu>
Nov 08 21:43:46 user nova-compute[75993]:   <devices>
Nov 08 21:43:46 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:43:46 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:43:46 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk"/>
Nov 08 21:43:46 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:43:46 user nova-compute[75993]:     </disk>
Nov 08 21:43:46 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:43:46 user nova-compute[75993]:       <mac address="fa:16:3e:9e:8c:e8"/>
Nov 08 21:43:46 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:43:46 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:43:46 user nova-compute[75993]:       <target dev="tap8c7b1cf2-c7"/>
Nov 08 21:43:46 user nova-compute[75993]:     </interface>
Nov 08 21:43:46 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:43:46 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/console.log" append="off"/>
Nov 08 21:43:46 user nova-compute[75993]:     </serial>
Nov 08 21:43:46 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:43:46 user nova-compute[75993]:     <video>
Nov 08 21:43:46 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:43:46 user nova-compute[75993]:     </video>
Nov 08 21:43:46 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:43:46 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:43:46 user nova-compute[75993]:     </rng>
Nov 08 21:43:46 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:43:46 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:43:46 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:43:46 user nova-compute[75993]:     </memballoon>
Nov 08 21:43:46 user nova-compute[75993]:   </devices>
Nov 08 21:43:46 user nova-compute[75993]: </domain>
Nov 08 21:43:46 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] No BDM found with device name sda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:43:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] No VIF found with MAC fa:16:3e:e9:c3:86, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.objects.instance [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'trusted_certs' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.objects.base [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e2d31906-850b-4428-8dff-b9ab69fc6cce tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.086s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.219s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Cannot resize image /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.objects.instance [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'migration_context' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.objects.base [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Object Instance<35ca9fea-481a-42ac-8558-c5140e71de59> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69742388',display_name='tempest-AttachVolumeTestJSON-server-69742388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69742388',id=4,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6oVnaQGjrVAmxsL/HSmftgrrbaB7fw/oPsVgbPjyOcbxzfpKxxWenMze7QWGbAaraNrcOiGtYnTUSvQT2S8k2jlnDmVZFkcsfxNh5h1CEZ87atD5chgSwK78UubB8vnQ==',key_name='tempest-keypair-1705684380',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-ufo08u5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:41:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=35ca9fea-481a-42ac-8558-c5140e71de59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG os_vif [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95f43a20-3158-5e1a-be00-087d33226317', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c7b1cf2-c7, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c7b1cf2-c7, col_values=(('qos', UUID('31ad5ecb-e309-4f8e-a986-be011b1a33af')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c7b1cf2-c7, col_values=(('external_ids', {'iface-id': '8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:8c:e8', 'vm-uuid': '35ca9fea-481a-42ac-8558-c5140e71de59'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:47 user nova-compute[75993]: INFO os_vif [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7')
Nov 08 21:43:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "48be721e-71fc-488f-b626-54726d7f77b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:47 user nova-compute[75993]: INFO nova.compute.manager [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Detaching volume ad20ab85-eba1-49e1-8e40-d71434f248b1
Nov 08 21:43:47 user nova-compute[75993]: INFO nova.virt.block_device [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Attempting to driver detach volume ad20ab85-eba1-49e1-8e40-d71434f248b1 from mountpoint /dev/sdc
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Attempting to detach device sdc from instance 48be721e-71fc-488f-b626-54726d7f77b6 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:43:47 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:43:47 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:43:47 user nova-compute[75993]:   <target dev="sdc" bus="scsi"/>
Nov 08 21:43:47 user nova-compute[75993]:   <serial>ad20ab85-eba1-49e1-8e40-d71434f248b1</serial>
Nov 08 21:43:47 user nova-compute[75993]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 21:43:47 user nova-compute[75993]: </disk>
Nov 08 21:43:47 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:43:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Successfully detached device sdc from instance 48be721e-71fc-488f-b626-54726d7f77b6 from the persistent domain config.
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 48be721e-71fc-488f-b626-54726d7f77b6 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:43:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:43:47 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:43:47 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:43:47 user nova-compute[75993]:   <target dev="sdc" bus="scsi"/>
Nov 08 21:43:47 user nova-compute[75993]:   <serial>ad20ab85-eba1-49e1-8e40-d71434f248b1</serial>
Nov 08 21:43:47 user nova-compute[75993]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 08 21:43:47 user nova-compute[75993]: </disk>
Nov 08 21:43:47 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "cf0fc4d6-3e59-429f-863a-686865d3c977" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:43:48 user nova-compute[75993]: INFO nova.compute.claims [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Claim successful on node user
Nov 08 21:43:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 48be721e-71fc-488f-b626-54726d7f77b6 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:43:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:43:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:43:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG nova.policy [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7ce4dd5fa2e4dbfbc817e77249680c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a324eff68a4f3ebbf73ca83664e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:43:49 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Creating image(s)
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "/opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "/opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-3e64a0b5-ae63-4d03-a4d1-5c39303bbf75 req-57c443b0-1301-451a-a985-d7d5aedb3201 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e64a0b5-ae63-4d03-a4d1-5c39303bbf75 req-57c443b0-1301-451a-a985-d7d5aedb3201 service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e64a0b5-ae63-4d03-a4d1-5c39303bbf75 req-57c443b0-1301-451a-a985-d7d5aedb3201 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e64a0b5-ae63-4d03-a4d1-5c39303bbf75 req-57c443b0-1301-451a-a985-d7d5aedb3201 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-3e64a0b5-ae63-4d03-a4d1-5c39303bbf75 req-57c443b0-1301-451a-a985-d7d5aedb3201 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:49 user nova-compute[75993]: WARNING nova.compute.manager [req-3e64a0b5-ae63-4d03-a4d1-5c39303bbf75 req-57c443b0-1301-451a-a985-d7d5aedb3201 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received unexpected event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with vm_state stopped and task_state powering-on.
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.230s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk 1073741824" returned: 0 in 0.062s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.207s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG nova.network.neutron [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Successfully created port: d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:43:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Cannot resize image /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Ensure instance console log exists: /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG nova.network.neutron [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Successfully updated port: d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "refresh_cache-cf0fc4d6-3e59-429f-863a-686865d3c977" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquired lock "refresh_cache-cf0fc4d6-3e59-429f-863a-686865d3c977" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG nova.network.neutron [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-6e604f30-7a88-41ae-959e-696c471bf444 req-d49cd9c1-ce29-4c2f-b13b-48e67f4ecead service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Received event network-changed-d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-6e604f30-7a88-41ae-959e-696c471bf444 req-d49cd9c1-ce29-4c2f-b13b-48e67f4ecead service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Refreshing instance network info cache due to event network-changed-d91898a8-7a2c-4438-8187-6948a8e41853. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6e604f30-7a88-41ae-959e-696c471bf444 req-d49cd9c1-ce29-4c2f-b13b-48e67f4ecead service nova] Acquiring lock "refresh_cache-cf0fc4d6-3e59-429f-863a-686865d3c977" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG nova.network.neutron [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:50 user nova-compute[75993]: DEBUG nova.network.neutron [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Updating instance_info_cache with network_info: [{"id": "d91898a8-7a2c-4438-8187-6948a8e41853", "address": "fa:16:3e:28:92:7e", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91898a8-7a", "ovs_interfaceid": "d91898a8-7a2c-4438-8187-6948a8e41853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Releasing lock "refresh_cache-cf0fc4d6-3e59-429f-863a-686865d3c977" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Instance network_info: |[{"id": "d91898a8-7a2c-4438-8187-6948a8e41853", "address": "fa:16:3e:28:92:7e", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91898a8-7a", "ovs_interfaceid": "d91898a8-7a2c-4438-8187-6948a8e41853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6e604f30-7a88-41ae-959e-696c471bf444 req-d49cd9c1-ce29-4c2f-b13b-48e67f4ecead service nova] Acquired lock "refresh_cache-cf0fc4d6-3e59-429f-863a-686865d3c977" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.network.neutron [req-6e604f30-7a88-41ae-959e-696c471bf444 req-d49cd9c1-ce29-4c2f-b13b-48e67f4ecead service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Refreshing network info cache for port d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Start _get_guest_xml network_info=[{"id": "d91898a8-7a2c-4438-8187-6948a8e41853", "address": "fa:16:3e:28:92:7e", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91898a8-7a", "ovs_interfaceid": "d91898a8-7a2c-4438-8187-6948a8e41853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:43:51 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:43:51 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-753632063',display_name='tempest-VolumesActionsTest-instance-753632063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-753632063',id=22,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a324eff68a4f3ebbf73ca83664e50b',ramdisk_id='',reservation_id='r-2qvz22qq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1465914463',owner_user_name='tempest-VolumesActionsTest-1465914463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:43:49Z,user_data=None,user_id='f7ce4dd5fa2e4dbfbc817e77249680c7',uuid=cf0fc4d6-3e59-429f-863a-686865d3c977,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d91898a8-7a2c-4438-8187-6948a8e41853", "address": "fa:16:3e:28:92:7e", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91898a8-7a", "ovs_interfaceid": "d91898a8-7a2c-4438-8187-6948a8e41853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converting VIF {"id": "d91898a8-7a2c-4438-8187-6948a8e41853", "address": "fa:16:3e:28:92:7e", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91898a8-7a", "ovs_interfaceid": "d91898a8-7a2c-4438-8187-6948a8e41853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:92:7e,bridge_name='br-int',has_traffic_filtering=True,id=d91898a8-7a2c-4438-8187-6948a8e41853,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91898a8-7a') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.objects.instance [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lazy-loading 'pci_devices' on Instance uuid cf0fc4d6-3e59-429f-863a-686865d3c977 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:43:51 user nova-compute[75993]:   <uuid>cf0fc4d6-3e59-429f-863a-686865d3c977</uuid>
Nov 08 21:43:51 user nova-compute[75993]:   <name>instance-00000016</name>
Nov 08 21:43:51 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:43:51 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:43:51 user nova-compute[75993]:   <metadata>
Nov 08 21:43:51 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:43:51 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:43:51 user nova-compute[75993]:       <nova:name>tempest-VolumesActionsTest-instance-753632063</nova:name>
Nov 08 21:43:51 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:43:51</nova:creationTime>
Nov 08 21:43:51 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:43:51 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:43:51 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:43:51 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:43:51 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:43:51 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:43:51 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:43:51 user nova-compute[75993]:       <nova:owner>
Nov 08 21:43:51 user nova-compute[75993]:         <nova:user uuid="f7ce4dd5fa2e4dbfbc817e77249680c7">tempest-VolumesActionsTest-1465914463-project-member</nova:user>
Nov 08 21:43:51 user nova-compute[75993]:         <nova:project uuid="93a324eff68a4f3ebbf73ca83664e50b">tempest-VolumesActionsTest-1465914463</nova:project>
Nov 08 21:43:51 user nova-compute[75993]:       </nova:owner>
Nov 08 21:43:51 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:43:51 user nova-compute[75993]:       <nova:ports>
Nov 08 21:43:51 user nova-compute[75993]:         <nova:port uuid="d91898a8-7a2c-4438-8187-6948a8e41853">
Nov 08 21:43:51 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 21:43:51 user nova-compute[75993]:         </nova:port>
Nov 08 21:43:51 user nova-compute[75993]:       </nova:ports>
Nov 08 21:43:51 user nova-compute[75993]:     </nova:instance>
Nov 08 21:43:51 user nova-compute[75993]:   </metadata>
Nov 08 21:43:51 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:43:51 user nova-compute[75993]:     <system>
Nov 08 21:43:51 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:43:51 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:43:51 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:43:51 user nova-compute[75993]:       <entry name="serial">cf0fc4d6-3e59-429f-863a-686865d3c977</entry>
Nov 08 21:43:51 user nova-compute[75993]:       <entry name="uuid">cf0fc4d6-3e59-429f-863a-686865d3c977</entry>
Nov 08 21:43:51 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:43:51 user nova-compute[75993]:     </system>
Nov 08 21:43:51 user nova-compute[75993]:   </sysinfo>
Nov 08 21:43:51 user nova-compute[75993]:   <os>
Nov 08 21:43:51 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:43:51 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:43:51 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:43:51 user nova-compute[75993]:   </os>
Nov 08 21:43:51 user nova-compute[75993]:   <features>
Nov 08 21:43:51 user nova-compute[75993]:     <acpi/>
Nov 08 21:43:51 user nova-compute[75993]:     <apic/>
Nov 08 21:43:51 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:43:51 user nova-compute[75993]:   </features>
Nov 08 21:43:51 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:43:51 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:43:51 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:43:51 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:43:51 user nova-compute[75993]:   </clock>
Nov 08 21:43:51 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:43:51 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:43:51 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:43:51 user nova-compute[75993]:   </cpu>
Nov 08 21:43:51 user nova-compute[75993]:   <devices>
Nov 08 21:43:51 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:43:51 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:43:51 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk"/>
Nov 08 21:43:51 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:43:51 user nova-compute[75993]:     </disk>
Nov 08 21:43:51 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:43:51 user nova-compute[75993]:       <mac address="fa:16:3e:28:92:7e"/>
Nov 08 21:43:51 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:43:51 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:43:51 user nova-compute[75993]:       <target dev="tapd91898a8-7a"/>
Nov 08 21:43:51 user nova-compute[75993]:     </interface>
Nov 08 21:43:51 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:43:51 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/console.log" append="off"/>
Nov 08 21:43:51 user nova-compute[75993]:     </serial>
Nov 08 21:43:51 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:43:51 user nova-compute[75993]:     <video>
Nov 08 21:43:51 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:43:51 user nova-compute[75993]:     </video>
Nov 08 21:43:51 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:43:51 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:43:51 user nova-compute[75993]:     </rng>
Nov 08 21:43:51 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:43:51 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:43:51 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:43:51 user nova-compute[75993]:     </memballoon>
Nov 08 21:43:51 user nova-compute[75993]:   </devices>
Nov 08 21:43:51 user nova-compute[75993]: </domain>
Nov 08 21:43:51 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-753632063',display_name='tempest-VolumesActionsTest-instance-753632063',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-753632063',id=22,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a324eff68a4f3ebbf73ca83664e50b',ramdisk_id='',reservation_id='r-2qvz22qq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1465914463',owner_user_name='tempest-VolumesActionsTest-1465914463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:43:49Z,user_data=None,user_id='f7ce4dd5fa2e4dbfbc817e77249680c7',uuid=cf0fc4d6-3e59-429f-863a-686865d3c977,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d91898a8-7a2c-4438-8187-6948a8e41853", "address": "fa:16:3e:28:92:7e", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91898a8-7a", "ovs_interfaceid": "d91898a8-7a2c-4438-8187-6948a8e41853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converting VIF {"id": "d91898a8-7a2c-4438-8187-6948a8e41853", "address": "fa:16:3e:28:92:7e", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91898a8-7a", "ovs_interfaceid": "d91898a8-7a2c-4438-8187-6948a8e41853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:92:7e,bridge_name='br-int',has_traffic_filtering=True,id=d91898a8-7a2c-4438-8187-6948a8e41853,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91898a8-7a') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG os_vif [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:92:7e,bridge_name='br-int',has_traffic_filtering=True,id=d91898a8-7a2c-4438-8187-6948a8e41853,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91898a8-7a') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '266cb6a0-65e9-5ee9-a615-325449c47237', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd91898a8-7a, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd91898a8-7a, col_values=(('qos', UUID('8d2f41b5-e35b-429a-90b2-e7fc98e41737')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd91898a8-7a, col_values=(('external_ids', {'iface-id': 'd91898a8-7a2c-4438-8187-6948a8e41853', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:92:7e', 'vm-uuid': 'cf0fc4d6-3e59-429f-863a-686865d3c977'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:51 user nova-compute[75993]: INFO os_vif [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:92:7e,bridge_name='br-int',has_traffic_filtering=True,id=d91898a8-7a2c-4438-8187-6948a8e41853,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91898a8-7a')
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] No VIF found with MAC fa:16:3e:28:92:7e, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-d3babe68-cb76-4b2b-8f7b-6aa3ad86b091 req-3ae435e0-62ce-4fa1-bd88-5e8d782e7c5d service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d3babe68-cb76-4b2b-8f7b-6aa3ad86b091 req-3ae435e0-62ce-4fa1-bd88-5e8d782e7c5d service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d3babe68-cb76-4b2b-8f7b-6aa3ad86b091 req-3ae435e0-62ce-4fa1-bd88-5e8d782e7c5d service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d3babe68-cb76-4b2b-8f7b-6aa3ad86b091 req-3ae435e0-62ce-4fa1-bd88-5e8d782e7c5d service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-d3babe68-cb76-4b2b-8f7b-6aa3ad86b091 req-3ae435e0-62ce-4fa1-bd88-5e8d782e7c5d service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:51 user nova-compute[75993]: WARNING nova.compute.manager [req-d3babe68-cb76-4b2b-8f7b-6aa3ad86b091 req-3ae435e0-62ce-4fa1-bd88-5e8d782e7c5d service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received unexpected event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with vm_state stopped and task_state powering-on.
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.network.neutron [req-6e604f30-7a88-41ae-959e-696c471bf444 req-d49cd9c1-ce29-4c2f-b13b-48e67f4ecead service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Updated VIF entry in instance network info cache for port d91898a8-7a2c-4438-8187-6948a8e41853. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.network.neutron [req-6e604f30-7a88-41ae-959e-696c471bf444 req-d49cd9c1-ce29-4c2f-b13b-48e67f4ecead service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Updating instance_info_cache with network_info: [{"id": "d91898a8-7a2c-4438-8187-6948a8e41853", "address": "fa:16:3e:28:92:7e", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91898a8-7a", "ovs_interfaceid": "d91898a8-7a2c-4438-8187-6948a8e41853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6e604f30-7a88-41ae-959e-696c471bf444 req-d49cd9c1-ce29-4c2f-b13b-48e67f4ecead service nova] Releasing lock "refresh_cache-cf0fc4d6-3e59-429f-863a-686865d3c977" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:43:51 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance rebooted successfully.
Nov 08 21:43:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-54131064-3881-40ff-be6a-ce350b5138d0 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-75fe954a-bc2c-4e9a-a2d1-a277d81b3945 req-fffa270f-b098-45e6-87a6-527937bdc5d1 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Received event network-vif-plugged-d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-75fe954a-bc2c-4e9a-a2d1-a277d81b3945 req-fffa270f-b098-45e6-87a6-527937bdc5d1 service nova] Acquiring lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-75fe954a-bc2c-4e9a-a2d1-a277d81b3945 req-fffa270f-b098-45e6-87a6-527937bdc5d1 service nova] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-75fe954a-bc2c-4e9a-a2d1-a277d81b3945 req-fffa270f-b098-45e6-87a6-527937bdc5d1 service nova] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-75fe954a-bc2c-4e9a-a2d1-a277d81b3945 req-fffa270f-b098-45e6-87a6-527937bdc5d1 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] No waiting events found dispatching network-vif-plugged-d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:52 user nova-compute[75993]: WARNING nova.compute.manager [req-75fe954a-bc2c-4e9a-a2d1-a277d81b3945 req-fffa270f-b098-45e6-87a6-527937bdc5d1 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Received unexpected event network-vif-plugged-d91898a8-7a2c-4438-8187-6948a8e41853 for instance with vm_state building and task_state spawning.
Nov 08 21:43:53 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updating instance_info_cache with network_info: [{"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:43:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-35ca9fea-481a-42ac-8558-c5140e71de59" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:43:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:43:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:53 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.compute.manager [req-bc648281-7bca-448b-8673-a084b101f2a0 req-2b93f443-5601-496b-8386-16ccce751101 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Received event network-vif-plugged-d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bc648281-7bca-448b-8673-a084b101f2a0 req-2b93f443-5601-496b-8386-16ccce751101 service nova] Acquiring lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bc648281-7bca-448b-8673-a084b101f2a0 req-2b93f443-5601-496b-8386-16ccce751101 service nova] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bc648281-7bca-448b-8673-a084b101f2a0 req-2b93f443-5601-496b-8386-16ccce751101 service nova] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.compute.manager [req-bc648281-7bca-448b-8673-a084b101f2a0 req-2b93f443-5601-496b-8386-16ccce751101 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] No waiting events found dispatching network-vif-plugged-d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:43:55 user nova-compute[75993]: WARNING nova.compute.manager [req-bc648281-7bca-448b-8673-a084b101f2a0 req-2b93f443-5601-496b-8386-16ccce751101 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Received unexpected event network-vif-plugged-d91898a8-7a2c-4438-8187-6948a8e41853 for instance with vm_state building and task_state spawning.
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:43:55 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Instance spawned successfully.
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:43:55 user nova-compute[75993]: INFO nova.compute.manager [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 08 21:43:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:43:55 user nova-compute[75993]: INFO nova.compute.manager [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Took 7.22 seconds to build instance.
Nov 08 21:43:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-57bcc7e6-c5ae-4906-96ae-0db913848832 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.326s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:43:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:43:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:43:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:43:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:43:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:43:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:43:56 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:43:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:43:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:43:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.216s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.244s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:02 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:44:02 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7363MB free_disk=25.155311584472656GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 35ca9fea-481a-42ac-8558-c5140e71de59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9bb5a995-4872-4671-91ab-ca0127d65181 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 48be721e-71fc-488f-b626-54726d7f77b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance cf0fc4d6-3e59-429f-863a-686865d3c977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:44:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:44:03 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:44:03 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:44:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:44:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.683s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:44:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:44:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:44:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:44:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:44:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:44:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:44:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 21:44:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:44:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:44:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:08 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 48be721e-71fc-488f-b626-54726d7f77b6 is timed out.
Nov 08 21:44:08 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Successfully detached device sdc from instance 48be721e-71fc-488f-b626-54726d7f77b6 from the live domain config.
Nov 08 21:44:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ysEzCdVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:44:08 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[89625300-5553-47bd-912b-a0477a268add]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:44:08 user nova-compute[75993]: No targets found.
Nov 08 21:44:08 user nova-compute[75993]: iSNS:
Nov 08 21:44:08 user nova-compute[75993]: No targets found.
Nov 08 21:44:08 user nova-compute[75993]: STATIC:
Nov 08 21:44:08 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1
Nov 08 21:44:08 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:44:08 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:44:08 user nova-compute[75993]: FIRMWARE:
Nov 08 21:44:08 user nova-compute[75993]: No targets found.
Nov 08 21:44:08 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:44:08 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:44:08 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7087d483-dbff-48af-9471-d931dd00c8ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[767d2c42-6311-4821-bc7c-5b87cdfedc09]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 (non-flash)
Nov 08 21:44:08 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 (non-flash)
Nov 08 21:44:08 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544f9de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6cc70c-1156-4e66-8bca-04ff15cbf33e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8afa4e-07cd-4e79-b870-ccdbc5b9fa93]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc0e763-d0b1-4d6c-9727-c5d97b8d6c22]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[516698f7-6ea4-459a-b790-4fecfe8a8a13]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc854fec-d6e7-41a7-9627-ac47ae1389d9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[829d485f-7c1c-4c74-9c00-a7c152623163]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1, portal: 172.16.0.220,3260]
Nov 08 21:44:08 user nova-compute[75993]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1, portal: 172.16.0.220,3260] successful.
Nov 08 21:44:08 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad20ab85-eba1-49e1-8e40-d71434f248b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f74651a-36c5-4c84-93cd-cd8dbe4bc5ee]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] <== disconnect_volume: return (283ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:44:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:44:09 user nova-compute[75993]: DEBUG nova.objects.instance [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lazy-loading 'flavor' on Instance uuid 48be721e-71fc-488f-b626-54726d7f77b6 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:44:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b6c14ee8-8cea-46f5-88cb-d115582e3158 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.156s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "48be721e-71fc-488f-b626-54726d7f77b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "48be721e-71fc-488f-b626-54726d7f77b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:10 user nova-compute[75993]: INFO nova.compute.manager [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Terminating instance
Nov 08 21:44:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:44:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-b4214bb8-2327-4d86-a9d9-082faeec9071 req-f67e8bc2-55e5-4efa-8a3a-df8892b5154d service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Received event network-vif-unplugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b4214bb8-2327-4d86-a9d9-082faeec9071 req-f67e8bc2-55e5-4efa-8a3a-df8892b5154d service nova] Acquiring lock "48be721e-71fc-488f-b626-54726d7f77b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b4214bb8-2327-4d86-a9d9-082faeec9071 req-f67e8bc2-55e5-4efa-8a3a-df8892b5154d service nova] Lock "48be721e-71fc-488f-b626-54726d7f77b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b4214bb8-2327-4d86-a9d9-082faeec9071 req-f67e8bc2-55e5-4efa-8a3a-df8892b5154d service nova] Lock "48be721e-71fc-488f-b626-54726d7f77b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-b4214bb8-2327-4d86-a9d9-082faeec9071 req-f67e8bc2-55e5-4efa-8a3a-df8892b5154d service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] No waiting events found dispatching network-vif-unplugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-b4214bb8-2327-4d86-a9d9-082faeec9071 req-f67e8bc2-55e5-4efa-8a3a-df8892b5154d service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Received event network-vif-unplugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Instance destroyed successfully.
Nov 08 21:44:11 user nova-compute[75993]: DEBUG nova.objects.instance [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lazy-loading 'resources' on Instance uuid 48be721e-71fc-488f-b626-54726d7f77b6 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-08T21:41:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-883682111',display_name='tempest-AttachSCSIVolumeTestJSON-server-883682111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-883682111',id=17,image_ref='b94ba2a4-d52b-407d-a8c9-a170800131a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKKSJgEPYIB7xaQKp06bKC50f0LEhZAtsvvdnDiVe2i3lQgBwH4P+Ssxyu4zN0GRP3NSCRrptxRpDGJbWNy33ToqA8vGniZzBcqBwd2QNZIgXj0OheiwlyUPcL/Sv9Guow==',key_name='tempest-keypair-397978473',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:41:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d20a943ee8944e64b996328cf9ee3b27',ramdisk_id='',reservation_id='r-17q0516l',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='b94ba2a4-d52b-407d-a8c9-a170800131a7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1546388482',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1546388482-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:41:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='51264b2de70b434893d3a89659e23a4f',uuid=48be721e-71fc-488f-b626-54726d7f77b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "address": "fa:16:3e:e9:c3:86", "network": {"id": "7934fe06-31ea-44d5-81f6-96d6484361e8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2072104424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a943ee8944e64b996328cf9ee3b27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c9bef3-cd", "ovs_interfaceid": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Converting VIF {"id": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "address": "fa:16:3e:e9:c3:86", "network": {"id": "7934fe06-31ea-44d5-81f6-96d6484361e8", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2072104424-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d20a943ee8944e64b996328cf9ee3b27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap70c9bef3-cd", "ovs_interfaceid": "70c9bef3-cdb6-4b68-9638-e82ab3729f81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=70c9bef3-cdb6-4b68-9638-e82ab3729f81,network=Network(7934fe06-31ea-44d5-81f6-96d6484361e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c9bef3-cd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG os_vif [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=70c9bef3-cdb6-4b68-9638-e82ab3729f81,network=Network(7934fe06-31ea-44d5-81f6-96d6484361e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c9bef3-cd') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70c9bef3-cd, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c50c39b7-e147-4e99-aed0-7b6eff6d1139) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:11 user nova-compute[75993]: INFO os_vif [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:c3:86,bridge_name='br-int',has_traffic_filtering=True,id=70c9bef3-cdb6-4b68-9638-e82ab3729f81,network=Network(7934fe06-31ea-44d5-81f6-96d6484361e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70c9bef3-cd')
Nov 08 21:44:11 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Deleting instance files /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6_del
Nov 08 21:44:11 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Deletion of /opt/stack/data/nova/instances/48be721e-71fc-488f-b626-54726d7f77b6_del complete
Nov 08 21:44:11 user nova-compute[75993]: INFO nova.compute.manager [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 08 21:44:11 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:44:11 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:44:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:12 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:44:12 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Took 1.11 seconds to deallocate network for instance.
Nov 08 21:44:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-a18dee8f-193b-46b8-90ea-e2fc73090161 req-6c3df2cf-dd64-4d9e-a1d2-5f9384b96b03 service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Received event network-vif-deleted-70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:44:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-4bf52b1b-2b44-4734-800a-782f889b5592 req-7ba6a0ca-c908-4e52-bb36-dd6e9ef326eb service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Received event network-vif-plugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:44:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4bf52b1b-2b44-4734-800a-782f889b5592 req-7ba6a0ca-c908-4e52-bb36-dd6e9ef326eb service nova] Acquiring lock "48be721e-71fc-488f-b626-54726d7f77b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4bf52b1b-2b44-4734-800a-782f889b5592 req-7ba6a0ca-c908-4e52-bb36-dd6e9ef326eb service nova] Lock "48be721e-71fc-488f-b626-54726d7f77b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4bf52b1b-2b44-4734-800a-782f889b5592 req-7ba6a0ca-c908-4e52-bb36-dd6e9ef326eb service nova] Lock "48be721e-71fc-488f-b626-54726d7f77b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-4bf52b1b-2b44-4734-800a-782f889b5592 req-7ba6a0ca-c908-4e52-bb36-dd6e9ef326eb service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] No waiting events found dispatching network-vif-plugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:44:13 user nova-compute[75993]: WARNING nova.compute.manager [req-4bf52b1b-2b44-4734-800a-782f889b5592 req-7ba6a0ca-c908-4e52-bb36-dd6e9ef326eb service nova] [instance: 48be721e-71fc-488f-b626-54726d7f77b6] Received unexpected event network-vif-plugged-70c9bef3-cdb6-4b68-9638-e82ab3729f81 for instance with vm_state deleted and task_state None.
Nov 08 21:44:13 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:44:13 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:44:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:13 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Deleted allocations for instance 48be721e-71fc-488f-b626-54726d7f77b6
Nov 08 21:44:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-adbd5a56-a754-45bf-9ab3-d817fff8b832 tempest-AttachSCSIVolumeTestJSON-1546388482 tempest-AttachSCSIVolumeTestJSON-1546388482-project-member] Lock "48be721e-71fc-488f-b626-54726d7f77b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.669s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-86d18975-f4d7-41c9-83ee-0aac708398ca req-934a7bc4-f0dd-4a5e-8ffa-faaab6eaa955 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received event network-changed-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-86d18975-f4d7-41c9-83ee-0aac708398ca req-934a7bc4-f0dd-4a5e-8ffa-faaab6eaa955 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Refreshing instance network info cache due to event network-changed-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-86d18975-f4d7-41c9-83ee-0aac708398ca req-934a7bc4-f0dd-4a5e-8ffa-faaab6eaa955 service nova] Acquiring lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-86d18975-f4d7-41c9-83ee-0aac708398ca req-934a7bc4-f0dd-4a5e-8ffa-faaab6eaa955 service nova] Acquired lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG nova.network.neutron [req-86d18975-f4d7-41c9-83ee-0aac708398ca req-934a7bc4-f0dd-4a5e-8ffa-faaab6eaa955 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Refreshing network info cache for port 7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "9bb5a995-4872-4671-91ab-ca0127d65181" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:24 user nova-compute[75993]: INFO nova.compute.manager [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Terminating instance
Nov 08 21:44:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-86d18975-f4d7-41c9-83ee-0aac708398ca req-934a7bc4-f0dd-4a5e-8ffa-faaab6eaa955 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Updated VIF entry in instance network info cache for port 7d3aebee-e3d9-4c37-be5c-0cc382f7ed59. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-86d18975-f4d7-41c9-83ee-0aac708398ca req-934a7bc4-f0dd-4a5e-8ffa-faaab6eaa955 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Updating instance_info_cache with network_info: [{"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-b72b539f-a946-492c-9767-5811da41e1e3 req-01f72694-261b-4b35-81ab-4f4c91d5292d service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received event network-vif-unplugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b72b539f-a946-492c-9767-5811da41e1e3 req-01f72694-261b-4b35-81ab-4f4c91d5292d service nova] Acquiring lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b72b539f-a946-492c-9767-5811da41e1e3 req-01f72694-261b-4b35-81ab-4f4c91d5292d service nova] Lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b72b539f-a946-492c-9767-5811da41e1e3 req-01f72694-261b-4b35-81ab-4f4c91d5292d service nova] Lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-b72b539f-a946-492c-9767-5811da41e1e3 req-01f72694-261b-4b35-81ab-4f4c91d5292d service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] No waiting events found dispatching network-vif-unplugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-b72b539f-a946-492c-9767-5811da41e1e3 req-01f72694-261b-4b35-81ab-4f4c91d5292d service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received event network-vif-unplugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-86d18975-f4d7-41c9-83ee-0aac708398ca req-934a7bc4-f0dd-4a5e-8ffa-faaab6eaa955 service nova] Releasing lock "refresh_cache-9bb5a995-4872-4671-91ab-ca0127d65181" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:44:25 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Instance destroyed successfully.
Nov 08 21:44:25 user nova-compute[75993]: DEBUG nova.objects.instance [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lazy-loading 'resources' on Instance uuid 9bb5a995-4872-4671-91ab-ca0127d65181 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:35:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-75408681',display_name='tempest-TestStampPattern-server-75408681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-75408681',id=10,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzi4BBwOWSPcXvNFJcnuunmlc1jVzPYxgIUIXRPn88VowR8XT4JMB17/mhLEw562KI2F8/I3ODTLYr6iRjeOTY7XOCMuEaybFzaDT0RveYsc2TN5uGVN/y+/gl9KBJK0g==',key_name='tempest-TestStampPattern-232827460',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:35:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='872f700d69d8494f9076e7f0d58e14d3',ramdisk_id='',reservation_id='r-lt22d8wl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1350261875',owner_user_name='tempest-TestStampPattern-1350261875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:39:34Z,user_data=None,user_id='0ab412f002ec4fe1b978f874d53a2229',uuid=9bb5a995-4872-4671-91ab-ca0127d65181,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converting VIF {"id": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "address": "fa:16:3e:f3:07:9b", "network": {"id": "22551709-707d-4d54-8857-f927d93aa356", "bridge": "br-int", "label": "tempest-TestStampPattern-286869440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "872f700d69d8494f9076e7f0d58e14d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d3aebee-e3", "ovs_interfaceid": "7d3aebee-e3d9-4c37-be5c-0cc382f7ed59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d3aebee-e3d9-4c37-be5c-0cc382f7ed59,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3aebee-e3') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG os_vif [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d3aebee-e3d9-4c37-be5c-0cc382f7ed59,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3aebee-e3') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d3aebee-e3, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32e78d5e-d2e3-4d98-952b-3ad50771e4df) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:25 user nova-compute[75993]: INFO os_vif [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:07:9b,bridge_name='br-int',has_traffic_filtering=True,id=7d3aebee-e3d9-4c37-be5c-0cc382f7ed59,network=Network(22551709-707d-4d54-8857-f927d93aa356),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d3aebee-e3')
Nov 08 21:44:25 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Deleting instance files /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181_del
Nov 08 21:44:25 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Deletion of /opt/stack/data/nova/instances/9bb5a995-4872-4671-91ab-ca0127d65181_del complete
Nov 08 21:44:25 user nova-compute[75993]: INFO nova.compute.manager [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 08 21:44:25 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:44:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:26 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:44:26 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Took 0.71 seconds to deallocate network for instance.
Nov 08 21:44:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-3a343484-a296-44cf-aa56-1c073f21d1b2 req-cf340fec-13b2-4af1-8e1d-611ff634e731 service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received event network-vif-deleted-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:44:26 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:44:26 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:44:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:27 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Deleted allocations for instance 9bb5a995-4872-4671-91ab-ca0127d65181
Nov 08 21:44:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4d6b3a55-e901-44ba-ab2f-52e4987992f0 tempest-TestStampPattern-1350261875 tempest-TestStampPattern-1350261875-project-member] Lock "9bb5a995-4872-4671-91ab-ca0127d65181" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.395s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-3e3318fe-3ef3-4328-9a04-c6a07a702c1d req-3322bc3b-ebc0-4633-b46c-f76d06f9995f service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received event network-vif-plugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:44:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e3318fe-3ef3-4328-9a04-c6a07a702c1d req-3322bc3b-ebc0-4633-b46c-f76d06f9995f service nova] Acquiring lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e3318fe-3ef3-4328-9a04-c6a07a702c1d req-3322bc3b-ebc0-4633-b46c-f76d06f9995f service nova] Lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e3318fe-3ef3-4328-9a04-c6a07a702c1d req-3322bc3b-ebc0-4633-b46c-f76d06f9995f service nova] Lock "9bb5a995-4872-4671-91ab-ca0127d65181-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-3e3318fe-3ef3-4328-9a04-c6a07a702c1d req-3322bc3b-ebc0-4633-b46c-f76d06f9995f service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] No waiting events found dispatching network-vif-plugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:44:27 user nova-compute[75993]: WARNING nova.compute.manager [req-3e3318fe-3ef3-4328-9a04-c6a07a702c1d req-3322bc3b-ebc0-4633-b46c-f76d06f9995f service nova] [instance: 9bb5a995-4872-4671-91ab-ca0127d65181] Received unexpected event network-vif-plugged-7d3aebee-e3d9-4c37-be5c-0cc382f7ed59 for instance with vm_state deleted and task_state None.
Nov 08 21:44:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:44:36 user nova-compute[75993]: INFO nova.compute.manager [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] instance snapshotting
Nov 08 21:44:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Beginning live snapshot process
Nov 08 21:44:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json -f qcow2 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json -f qcow2 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json -f qcow2" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_x_cg8hj/67b39dcdc4bd4aac92aa50a1c7b16cf9.delta 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp_x_cg8hj/67b39dcdc4bd4aac92aa50a1c7b16cf9.delta 1073741824" returned: 0 in 0.091s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:37 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 21:44:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:44:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:44:39 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 21:44:39 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:44:39 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_x_cg8hj/67b39dcdc4bd4aac92aa50a1c7b16cf9.delta /opt/stack/data/nova/instances/snapshots/tmp_x_cg8hj/67b39dcdc4bd4aac92aa50a1c7b16cf9 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:39 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp_x_cg8hj/67b39dcdc4bd4aac92aa50a1c7b16cf9.delta /opt/stack/data/nova/instances/snapshots/tmp_x_cg8hj/67b39dcdc4bd4aac92aa50a1c7b16cf9" returned: 0 in 0.646s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:39 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Snapshot extracted, beginning image upload
Nov 08 21:44:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:42 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Snapshot image upload complete
Nov 08 21:44:42 user nova-compute[75993]: INFO nova.compute.manager [None req-d4faa079-e3f0-433b-a56f-fb281a17fdab tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Took 5.77 seconds to snapshot the instance on the hypervisor.
Nov 08 21:44:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-621d2f87-e5b6-4913-86bc-00eeaca46618 req-7aa0abf5-8fae-479c-bbbb-ff3823e189d3 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-changed-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:44:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-621d2f87-e5b6-4913-86bc-00eeaca46618 req-7aa0abf5-8fae-479c-bbbb-ff3823e189d3 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Refreshing instance network info cache due to event network-changed-11175b03-1639-4225-a6ab-87b120bf2f3f. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:44:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-621d2f87-e5b6-4913-86bc-00eeaca46618 req-7aa0abf5-8fae-479c-bbbb-ff3823e189d3 service nova] Acquiring lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:44:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-621d2f87-e5b6-4913-86bc-00eeaca46618 req-7aa0abf5-8fae-479c-bbbb-ff3823e189d3 service nova] Acquired lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:44:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-621d2f87-e5b6-4913-86bc-00eeaca46618 req-7aa0abf5-8fae-479c-bbbb-ff3823e189d3 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Refreshing network info cache for port 11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:44:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-621d2f87-e5b6-4913-86bc-00eeaca46618 req-7aa0abf5-8fae-479c-bbbb-ff3823e189d3 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updated VIF entry in instance network info cache for port 11175b03-1639-4225-a6ab-87b120bf2f3f. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:44:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-621d2f87-e5b6-4913-86bc-00eeaca46618 req-7aa0abf5-8fae-479c-bbbb-ff3823e189d3 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updating instance_info_cache with network_info: [{"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:44:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-621d2f87-e5b6-4913-86bc-00eeaca46618 req-7aa0abf5-8fae-479c-bbbb-ff3823e189d3 service nova] Releasing lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:44:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:44 user nova-compute[75993]: DEBUG nova.objects.instance [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'flavor' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:44:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.167s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:45 user nova-compute[75993]: INFO nova.compute.manager [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Attaching volume 38977a6a-5b16-43d9-a128-c841537a50e7 to /dev/vdb
Nov 08 21:44:45 user nova-compute[75993]: DEBUG os_brick.utils [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b691e2-7642-4f8a-b1d6-3eca0d80ad17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ec8265-1272-4cde-bd2d-fe9f3348c86f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ad3dc4-9c27-4d6f-be3b-024b3271d36d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f5f59a-59c8-40b2-81cb-aef249579443]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:44:45 user nova-compute[75993]: INFO nova.compute.manager [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] instance snapshotting
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:44:45 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2214e92e-f2a1-4ba2-b751-9e26a6f6d6b7]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG os_brick.utils [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updating existing volume attachment record: 5637af15-31f0-4732-87da-abb5276780c0 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:44:45 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Beginning live snapshot process
Nov 08 21:44:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-a3d99444-0d17-4c1d-9dac-800d5855be26 req-0e1a97c0-61e8-45ce-80dd-b04ad5590721 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-changed-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-a3d99444-0d17-4c1d-9dac-800d5855be26 req-0e1a97c0-61e8-45ce-80dd-b04ad5590721 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Refreshing instance network info cache due to event network-changed-f7dc5cf6-90f1-4ec4-9704-49322e9e2179. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a3d99444-0d17-4c1d-9dac-800d5855be26 req-0e1a97c0-61e8-45ce-80dd-b04ad5590721 service nova] Acquiring lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a3d99444-0d17-4c1d-9dac-800d5855be26 req-0e1a97c0-61e8-45ce-80dd-b04ad5590721 service nova] Acquired lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG nova.network.neutron [req-a3d99444-0d17-4c1d-9dac-800d5855be26 req-0e1a97c0-61e8-45ce-80dd-b04ad5590721 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Refreshing network info cache for port f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json -f qcow2 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-4e91915a-3fc2-4d6e-a67a-461c24d46c03 req-26e90480-eabc-4680-8316-4fabe8d73622 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-changed-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-4e91915a-3fc2-4d6e-a67a-461c24d46c03 req-26e90480-eabc-4680-8316-4fabe8d73622 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Refreshing instance network info cache due to event network-changed-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4e91915a-3fc2-4d6e-a67a-461c24d46c03 req-26e90480-eabc-4680-8316-4fabe8d73622 service nova] Acquiring lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4e91915a-3fc2-4d6e-a67a-461c24d46c03 req-26e90480-eabc-4680-8316-4fabe8d73622 service nova] Acquired lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG nova.network.neutron [req-4e91915a-3fc2-4d6e-a67a-461c24d46c03 req-26e90480-eabc-4680-8316-4fabe8d73622 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Refreshing network info cache for port 0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json -f qcow2 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.198s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz94bntnu/be41b6e3fa344b5e89b645427106bd1d.delta 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz94bntnu/be41b6e3fa344b5e89b645427106bd1d.delta 1073741824" returned: 0 in 0.062s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:46 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 21:44:46 user nova-compute[75993]: DEBUG nova.network.neutron [req-a3d99444-0d17-4c1d-9dac-800d5855be26 req-0e1a97c0-61e8-45ce-80dd-b04ad5590721 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updated VIF entry in instance network info cache for port f7dc5cf6-90f1-4ec4-9704-49322e9e2179. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:44:46 user nova-compute[75993]: DEBUG nova.network.neutron [req-a3d99444-0d17-4c1d-9dac-800d5855be26 req-0e1a97c0-61e8-45ce-80dd-b04ad5590721 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updating instance_info_cache with network_info: [{"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:44:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a3d99444-0d17-4c1d-9dac-800d5855be26 req-0e1a97c0-61e8-45ce-80dd-b04ad5590721 service nova] Releasing lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:44:46 user nova-compute[75993]: DEBUG nova.network.neutron [req-4e91915a-3fc2-4d6e-a67a-461c24d46c03 req-26e90480-eabc-4680-8316-4fabe8d73622 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updated VIF entry in instance network info cache for port 0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:44:46 user nova-compute[75993]: DEBUG nova.network.neutron [req-4e91915a-3fc2-4d6e-a67a-461c24d46c03 req-26e90480-eabc-4680-8316-4fabe8d73622 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updating instance_info_cache with network_info: [{"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:44:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4e91915a-3fc2-4d6e-a67a-461c24d46c03 req-26e90480-eabc-4680-8316-4fabe8d73622 service nova] Releasing lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:44:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:44:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] COPY block job progress, current cursor: 19464192 final cursor: 75497472 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:44:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:44:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 21:44:48 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:44:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz94bntnu/be41b6e3fa344b5e89b645427106bd1d.delta /opt/stack/data/nova/instances/snapshots/tmpz94bntnu/be41b6e3fa344b5e89b645427106bd1d {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz94bntnu/be41b6e3fa344b5e89b645427106bd1d.delta /opt/stack/data/nova/instances/snapshots/tmpz94bntnu/be41b6e3fa344b5e89b645427106bd1d" returned: 0 in 0.584s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Snapshot extracted, beginning image upload
Nov 08 21:44:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:44:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:44:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 21:44:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:51 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Snapshot image upload complete
Nov 08 21:44:51 user nova-compute[75993]: INFO nova.compute.manager [None req-12f60001-17e1-4e72-bac7-66cc40337826 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Took 6.27 seconds to snapshot the instance on the hypervisor.
Nov 08 21:44:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:44:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:44:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:44:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:44:54 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:44:55 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance_info_cache with network_info: [{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:44:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:44:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:44:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:44:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:44:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:44:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:56 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:44:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG nova.objects.instance [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lazy-loading 'flavor' on Instance uuid f828891c-fc9f-4d73-8467-2fa0a804ffb0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:44:57 user nova-compute[75993]: INFO nova.compute.manager [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Attaching volume 5aecdf48-bd8b-4f46-acc9-012c71b590f0 to /dev/vdb
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG os_brick.utils [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5ee972-8cd8-4d31-a245-e4e1f53439e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b078f1a8-3b88-4450-9d34-7c37370f5284]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d273203-1066-47e3-8c4a-a5b794ee49b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46ef7c6-647f-404b-894e-f1f10c47bda0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:44:57 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[930eb343-36fc-4578-85df-f9488c2cbbac]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG os_brick.utils [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating existing volume attachment record: ba4f8a27-b887-45ed-8196-c46ac2c49d48 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:44:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:44:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:44:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.230s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:01 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:45:01 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:45:01 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7479MB free_disk=25.17056655883789GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:45:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 35ca9fea-481a-42ac-8558-c5140e71de59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance cf0fc4d6-3e59-429f-863a-686865d3c977 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.010s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 21:45:02 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:45:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:45:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:45:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:45:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:45:05 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:45:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgbJswIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:45:10 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:45:10 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:45:10 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[796402fe-5828-48f8-807c-c2080f1cbe1c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:45:10 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3e004c-7ae8-42bc-a82e-a4a9710ae6f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7] added
Nov 08 21:45:10 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[63853641-5940-477b-9e5e-8d58a6c316d7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[288c6e5b-f4e9-49c7-b6d1-d2c0e2c8141b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgbJswIA {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fgbJswIA" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[89655667-4e08-4671-8e2f-540857811b34]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fgbJswIA'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff1349d-cb51-4b3f-b011-07e8a18b4e11]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e56cdac-6fb4-4051-aa83-039ff50d356a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 21:45:10 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 21:45:10 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:45:10 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 21:45:10 user nova-compute[75993]: 
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7641e899-f06d-4539-abaf-d46fdeb372a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7, portal: 172.16.0.220,3260]
Nov 08 21:45:10 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7, portal: 172.16.0.220,3260] successful.
Nov 08 21:45:10 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a84ca55-ebe6-4e75-872d-1b5a1524977b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2886336b-0128-406e-9584-c4715e9937d5]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:45:10 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:45:10 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30fd7aa-2fbd-463a-ab92-14c52f8e5e16]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:11 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:45:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgbJswIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:45:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:45:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26661366531613961', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:45:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661366531613961', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:45:11 user nova-compute[75993]: DEBUG nova.objects.instance [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'flavor' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:45:11 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:45:11 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:45:11 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:45:11 user nova-compute[75993]:   <serial>38977a6a-5b16-43d9-a128-c841537a50e7</serial>
Nov 08 21:45:11 user nova-compute[75993]: </disk>
Nov 08 21:45:11 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:45:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:45:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:45:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No VIF found with MAC fa:16:3e:ba:f9:b5, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:45:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-633e4b2a-2124-4dad-95d7-a7c1b2b8aaaf tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.366s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:13 user nova-compute[75993]: INFO nova.compute.manager [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Rescuing
Nov 08 21:45:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:45:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquired lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:45:13 user nova-compute[75993]: DEBUG nova.network.neutron [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:45:13 user nova-compute[75993]: DEBUG nova.network.neutron [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updating instance_info_cache with network_info: [{"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:45:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Releasing lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:45:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-33dd5480-333d-4452-83fd-ed475dfb5c80 req-481bf433-3708-4ff2-85bf-0d01e3a44575 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-unplugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33dd5480-333d-4452-83fd-ed475dfb5c80 req-481bf433-3708-4ff2-85bf-0d01e3a44575 service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33dd5480-333d-4452-83fd-ed475dfb5c80 req-481bf433-3708-4ff2-85bf-0d01e3a44575 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33dd5480-333d-4452-83fd-ed475dfb5c80 req-481bf433-3708-4ff2-85bf-0d01e3a44575 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-33dd5480-333d-4452-83fd-ed475dfb5c80 req-481bf433-3708-4ff2-85bf-0d01e3a44575 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-unplugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:14 user nova-compute[75993]: WARNING nova.compute.manager [req-33dd5480-333d-4452-83fd-ed475dfb5c80 req-481bf433-3708-4ff2-85bf-0d01e3a44575 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received unexpected event network-vif-unplugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with vm_state active and task_state rescuing.
Nov 08 21:45:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Instance destroyed successfully.
Nov 08 21:45:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Attempting rescue
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75993) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Instance directory exists: not creating {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 21:45:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Creating image(s)
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "/opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'trusted_certs' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.206s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.rescue {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.rescue" returned: 0 in 0.051s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'migration_context' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.objects.base [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Start _get_guest_xml network_info=[{"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "vif_mac": "fa:16:3e:ba:f9:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'resources' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.objects.base [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'numa_topology' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.objects.base [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:45:14 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:45:14 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'vcpu_model' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.objects.base [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-744373370',display_name='tempest-ServerRescueNegativeTestJSON-server-744373370',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-744373370',id=19,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfaG+VVz6j6R6G5t7bwcEHBVcu/+dmqNAghC60RUji3tflLGmrnWfYsNyzH+deEaQt/WI6desKUvCG3tX6Gf6/56vWX/mcwYnd9ukQpvl703osps4raWWMOwQOlTKfOew==',key_name='tempest-keypair-807516927',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:43:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-0qegnfbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:43:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e02c3f49f1467498623a47a979a65d',uuid=b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "vif_mac": "fa:16:3e:ba:f9:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "vif_mac": "fa:16:3e:ba:f9:b5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:f9:b5,bridge_name='br-int',has_traffic_filtering=True,id=11175b03-1639-4225-a6ab-87b120bf2f3f,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11175b03-16') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'pci_devices' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.objects.base [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Object Instance<b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:45:14 user nova-compute[75993]:   <uuid>b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2</uuid>
Nov 08 21:45:14 user nova-compute[75993]:   <name>instance-00000013</name>
Nov 08 21:45:14 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:45:14 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:45:14 user nova-compute[75993]:   <metadata>
Nov 08 21:45:14 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:45:14 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:45:14 user nova-compute[75993]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-744373370</nova:name>
Nov 08 21:45:14 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:45:14</nova:creationTime>
Nov 08 21:45:14 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:45:14 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:45:14 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:45:14 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:45:14 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:45:14 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:45:14 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:45:14 user nova-compute[75993]:       <nova:owner>
Nov 08 21:45:14 user nova-compute[75993]:         <nova:user uuid="37e02c3f49f1467498623a47a979a65d">tempest-ServerRescueNegativeTestJSON-1699992008-project-member</nova:user>
Nov 08 21:45:14 user nova-compute[75993]:         <nova:project uuid="b1b3b0aa87ce49949be27025c497a432">tempest-ServerRescueNegativeTestJSON-1699992008</nova:project>
Nov 08 21:45:14 user nova-compute[75993]:       </nova:owner>
Nov 08 21:45:14 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:45:14 user nova-compute[75993]:       <nova:ports>
Nov 08 21:45:14 user nova-compute[75993]:         <nova:port uuid="11175b03-1639-4225-a6ab-87b120bf2f3f">
Nov 08 21:45:14 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 21:45:14 user nova-compute[75993]:         </nova:port>
Nov 08 21:45:14 user nova-compute[75993]:       </nova:ports>
Nov 08 21:45:14 user nova-compute[75993]:     </nova:instance>
Nov 08 21:45:14 user nova-compute[75993]:   </metadata>
Nov 08 21:45:14 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:45:14 user nova-compute[75993]:     <system>
Nov 08 21:45:14 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:45:14 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:45:14 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:45:14 user nova-compute[75993]:       <entry name="serial">b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2</entry>
Nov 08 21:45:14 user nova-compute[75993]:       <entry name="uuid">b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2</entry>
Nov 08 21:45:14 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:45:14 user nova-compute[75993]:     </system>
Nov 08 21:45:14 user nova-compute[75993]:   </sysinfo>
Nov 08 21:45:14 user nova-compute[75993]:   <os>
Nov 08 21:45:14 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:45:14 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:45:14 user nova-compute[75993]:   </os>
Nov 08 21:45:14 user nova-compute[75993]:   <features>
Nov 08 21:45:14 user nova-compute[75993]:     <acpi/>
Nov 08 21:45:14 user nova-compute[75993]:     <apic/>
Nov 08 21:45:14 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:45:14 user nova-compute[75993]:   </features>
Nov 08 21:45:14 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:45:14 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:45:14 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:45:14 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:45:14 user nova-compute[75993]:   </clock>
Nov 08 21:45:14 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:45:14 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:45:14 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:45:14 user nova-compute[75993]:   </cpu>
Nov 08 21:45:14 user nova-compute[75993]:   <devices>
Nov 08 21:45:14 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:45:14 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:45:14 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.rescue"/>
Nov 08 21:45:14 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:45:14 user nova-compute[75993]:     </disk>
Nov 08 21:45:14 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:45:14 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:45:14 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk"/>
Nov 08 21:45:14 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:45:14 user nova-compute[75993]:     </disk>
Nov 08 21:45:14 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:45:14 user nova-compute[75993]:       <mac address="fa:16:3e:ba:f9:b5"/>
Nov 08 21:45:14 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:45:14 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:45:14 user nova-compute[75993]:       <target dev="tap11175b03-16"/>
Nov 08 21:45:14 user nova-compute[75993]:     </interface>
Nov 08 21:45:14 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:45:14 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/console.log" append="off"/>
Nov 08 21:45:14 user nova-compute[75993]:     </serial>
Nov 08 21:45:14 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:45:14 user nova-compute[75993]:     <video>
Nov 08 21:45:14 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:45:14 user nova-compute[75993]:     </video>
Nov 08 21:45:14 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:45:14 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:45:14 user nova-compute[75993]:     </rng>
Nov 08 21:45:14 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:45:14 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:45:14 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:45:14 user nova-compute[75993]:     </memballoon>
Nov 08 21:45:14 user nova-compute[75993]:   </devices>
Nov 08 21:45:14 user nova-compute[75993]: </domain>
Nov 08 21:45:14 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:45:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Instance destroyed successfully.
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:45:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] No VIF found with MAC fa:16:3e:ba:f9:b5, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:45:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-ea9189ae-0c14-4360-8e8a-f16a6ebea57d req-5c36daec-e803-4630-932c-ee862ffcdda2 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ea9189ae-0c14-4360-8e8a-f16a6ebea57d req-5c36daec-e803-4630-932c-ee862ffcdda2 service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ea9189ae-0c14-4360-8e8a-f16a6ebea57d req-5c36daec-e803-4630-932c-ee862ffcdda2 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ea9189ae-0c14-4360-8e8a-f16a6ebea57d req-5c36daec-e803-4630-932c-ee862ffcdda2 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-ea9189ae-0c14-4360-8e8a-f16a6ebea57d req-5c36daec-e803-4630-932c-ee862ffcdda2 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:16 user nova-compute[75993]: WARNING nova.compute.manager [req-ea9189ae-0c14-4360-8e8a-f16a6ebea57d req-5c36daec-e803-4630-932c-ee862ffcdda2 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received unexpected event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with vm_state active and task_state rescuing.
Nov 08 21:45:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:18 user nova-compute[75993]: WARNING nova.compute.manager [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received unexpected event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with vm_state active and task_state rescuing.
Nov 08 21:45:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:18 user nova-compute[75993]: WARNING nova.compute.manager [req-4f540a21-c2bb-4969-bc36-4a6156616c79 req-bc59f070-b748-4bd4-9fa1-772f4397eaf7 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received unexpected event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with vm_state active and task_state rescuing.
Nov 08 21:45:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ef75bf1e-40c2-43e3-87bc-480b900d62c8 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:45:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELqlHWRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:45:24 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:45:24 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:45:24 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e29295-3117-4ce8-9cb9-b06ef6705706]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:45:24 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4768e328-8615-4aba-b9de-8df471dd54cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0] added
Nov 08 21:45:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc4ea97-4917-4eca-ad5b-af0e8b98e695]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9513d9e5-4e9b-4cb5-b58d-640029248357]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELqlHWRP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELqlHWRP" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce292769-26cc-47de-bead-67b6c1c8d6e9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELqlHWRP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[470d9283-6c90-4b7c-8d28-fa8a043ad7f9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[06109d99-062f-419f-8397-2d6fb421d215]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:45:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:45:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[75de4a86-42f4-4f0d-99cb-3bb2762ca1cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]
Nov 08 21:45:24 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.
Nov 08 21:45:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e837f749-2b76-44a7-8259-bda5f2739473]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c010461c-908d-46be-ad2a-b335f954cdf7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:45:24 user nova-compute[75993]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:45:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:45:24 user nova-compute[75993]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:45:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463ad00-56b1-4bc7-bbcd-78d6f17a63d4]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:45:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELqlHWRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:45:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:45:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '26461333534623164', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:45:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461333534623164', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:45:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:25 user nova-compute[75993]: DEBUG nova.objects.instance [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lazy-loading 'flavor' on Instance uuid f828891c-fc9f-4d73-8467-2fa0a804ffb0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:45:25 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:45:25 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 21:45:25 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:45:25 user nova-compute[75993]:   <serial>5aecdf48-bd8b-4f46-acc9-012c71b590f0</serial>
Nov 08 21:45:25 user nova-compute[75993]: </disk>
Nov 08 21:45:25 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:45:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:45:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:45:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] No VIF found with MAC fa:16:3e:ed:c9:e3, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:45:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3b553d8-a501-42f8-b10a-d7c7f79ec9d6 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.077s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:45:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:28 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:45:28 user nova-compute[75993]: INFO nova.compute.claims [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Claim successful on node user
Nov 08 21:45:28 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:45:28 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:45:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:28 user nova-compute[75993]: DEBUG nova.compute.manager [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:45:28 user nova-compute[75993]: DEBUG nova.compute.manager [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:45:28 user nova-compute[75993]: DEBUG nova.network.neutron [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:45:28 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:45:28 user nova-compute[75993]: DEBUG nova.compute.manager [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG nova.compute.manager [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:45:29 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Creating image(s)
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "/opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "/opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG nova.policy [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '666dbffed51d4b7baa09fd58c902d90b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26368a5aad0648e197d89fb1b7d5f2ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.263s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.227s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk 1073741824" returned: 0 in 0.056s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.199s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:45:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Cannot resize image /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Ensure instance console log exists: /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG nova.network.neutron [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Successfully created port: f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Stashing vm_state: active {{(pid=75993) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:45:30 user nova-compute[75993]: INFO nova.compute.claims [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Claim successful on node user
Nov 08 21:45:30 user nova-compute[75993]: INFO nova.compute.resource_tracker [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating resource usage from migration 7b299dd2-f2e1-4642-a3a8-a15f0ed5130b
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.network.neutron [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Successfully updated port: f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "refresh_cache-cd48056d-13f0-4d8e-839e-0bd392c60478" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquired lock "refresh_cache-cd48056d-13f0-4d8e-839e-0bd392c60478" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.network.neutron [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-12cd20f1-b727-46f4-aba8-aa1ef1f2d2c6 req-2f9fea1d-fb94-4729-b6b6-2aa665558182 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Received event network-changed-f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-12cd20f1-b727-46f4-aba8-aa1ef1f2d2c6 req-2f9fea1d-fb94-4729-b6b6-2aa665558182 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Refreshing instance network info cache due to event network-changed-f92989bc-c06f-4a11-a50d-5cd326889521. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-12cd20f1-b727-46f4-aba8-aa1ef1f2d2c6 req-2f9fea1d-fb94-4729-b6b6-2aa665558182 service nova] Acquiring lock "refresh_cache-cd48056d-13f0-4d8e-839e-0bd392c60478" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.network.neutron [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.656s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:31 user nova-compute[75993]: INFO nova.compute.manager [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Migrating
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:45:31 user nova-compute[75993]: INFO nova.compute.rpcapi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquired lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.network.neutron [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Updating instance_info_cache with network_info: [{"id": "f92989bc-c06f-4a11-a50d-5cd326889521", "address": "fa:16:3e:4d:61:3f", "network": {"id": "4e37144e-bc46-459b-b0ea-23789861dc06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1693242984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26368a5aad0648e197d89fb1b7d5f2ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92989bc-c0", "ovs_interfaceid": "f92989bc-c06f-4a11-a50d-5cd326889521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Releasing lock "refresh_cache-cd48056d-13f0-4d8e-839e-0bd392c60478" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Instance network_info: |[{"id": "f92989bc-c06f-4a11-a50d-5cd326889521", "address": "fa:16:3e:4d:61:3f", "network": {"id": "4e37144e-bc46-459b-b0ea-23789861dc06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1693242984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26368a5aad0648e197d89fb1b7d5f2ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92989bc-c0", "ovs_interfaceid": "f92989bc-c06f-4a11-a50d-5cd326889521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-12cd20f1-b727-46f4-aba8-aa1ef1f2d2c6 req-2f9fea1d-fb94-4729-b6b6-2aa665558182 service nova] Acquired lock "refresh_cache-cd48056d-13f0-4d8e-839e-0bd392c60478" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.network.neutron [req-12cd20f1-b727-46f4-aba8-aa1ef1f2d2c6 req-2f9fea1d-fb94-4729-b6b6-2aa665558182 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Refreshing network info cache for port f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Start _get_guest_xml network_info=[{"id": "f92989bc-c06f-4a11-a50d-5cd326889521", "address": "fa:16:3e:4d:61:3f", "network": {"id": "4e37144e-bc46-459b-b0ea-23789861dc06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1693242984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26368a5aad0648e197d89fb1b7d5f2ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92989bc-c0", "ovs_interfaceid": "f92989bc-c06f-4a11-a50d-5cd326889521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:31 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:45:31 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1190488140',display_name='tempest-TestServerVolumeAttachmentScenario-server-1190488140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1190488140',id=23,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdycmomWxn/irc4U5i3S8vmLTiBtjxOOE39w17t4ubtuIpBNjZvaBWRoyWc6lMzcu9Q1esy0WWCCLEkNl1gyR+FdEZGIPs4z/sLfssr9pl982re/lrOWkvNX64h3arK/A==',key_name='tempest-keypair-1880530491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26368a5aad0648e197d89fb1b7d5f2ff',ramdisk_id='',reservation_id='r-00ly8usz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1317810676',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1317810676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:45:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666dbffed51d4b7baa09fd58c902d90b',uuid=cd48056d-13f0-4d8e-839e-0bd392c60478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f92989bc-c06f-4a11-a50d-5cd326889521", "address": "fa:16:3e:4d:61:3f", "network": {"id": "4e37144e-bc46-459b-b0ea-23789861dc06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1693242984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26368a5aad0648e197d89fb1b7d5f2ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92989bc-c0", "ovs_interfaceid": "f92989bc-c06f-4a11-a50d-5cd326889521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Converting VIF {"id": "f92989bc-c06f-4a11-a50d-5cd326889521", "address": "fa:16:3e:4d:61:3f", "network": {"id": "4e37144e-bc46-459b-b0ea-23789861dc06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1693242984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26368a5aad0648e197d89fb1b7d5f2ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92989bc-c0", "ovs_interfaceid": "f92989bc-c06f-4a11-a50d-5cd326889521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=f92989bc-c06f-4a11-a50d-5cd326889521,network=Network(4e37144e-bc46-459b-b0ea-23789861dc06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92989bc-c0') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.objects.instance [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lazy-loading 'pci_devices' on Instance uuid cd48056d-13f0-4d8e-839e-0bd392c60478 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:45:31 user nova-compute[75993]:   <uuid>cd48056d-13f0-4d8e-839e-0bd392c60478</uuid>
Nov 08 21:45:31 user nova-compute[75993]:   <name>instance-00000017</name>
Nov 08 21:45:31 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:45:31 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:45:31 user nova-compute[75993]:   <metadata>
Nov 08 21:45:31 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:45:31 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:45:31 user nova-compute[75993]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1190488140</nova:name>
Nov 08 21:45:31 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:45:31</nova:creationTime>
Nov 08 21:45:31 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:45:31 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:45:31 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:45:31 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:45:31 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:45:31 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:45:31 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:45:31 user nova-compute[75993]:       <nova:owner>
Nov 08 21:45:31 user nova-compute[75993]:         <nova:user uuid="666dbffed51d4b7baa09fd58c902d90b">tempest-TestServerVolumeAttachmentScenario-1317810676-project-member</nova:user>
Nov 08 21:45:31 user nova-compute[75993]:         <nova:project uuid="26368a5aad0648e197d89fb1b7d5f2ff">tempest-TestServerVolumeAttachmentScenario-1317810676</nova:project>
Nov 08 21:45:31 user nova-compute[75993]:       </nova:owner>
Nov 08 21:45:31 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:45:31 user nova-compute[75993]:       <nova:ports>
Nov 08 21:45:31 user nova-compute[75993]:         <nova:port uuid="f92989bc-c06f-4a11-a50d-5cd326889521">
Nov 08 21:45:31 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 21:45:31 user nova-compute[75993]:         </nova:port>
Nov 08 21:45:31 user nova-compute[75993]:       </nova:ports>
Nov 08 21:45:31 user nova-compute[75993]:     </nova:instance>
Nov 08 21:45:31 user nova-compute[75993]:   </metadata>
Nov 08 21:45:31 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:45:31 user nova-compute[75993]:     <system>
Nov 08 21:45:31 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:45:31 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:45:31 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:45:31 user nova-compute[75993]:       <entry name="serial">cd48056d-13f0-4d8e-839e-0bd392c60478</entry>
Nov 08 21:45:31 user nova-compute[75993]:       <entry name="uuid">cd48056d-13f0-4d8e-839e-0bd392c60478</entry>
Nov 08 21:45:31 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:45:31 user nova-compute[75993]:     </system>
Nov 08 21:45:31 user nova-compute[75993]:   </sysinfo>
Nov 08 21:45:31 user nova-compute[75993]:   <os>
Nov 08 21:45:31 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:45:31 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:45:31 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:45:31 user nova-compute[75993]:   </os>
Nov 08 21:45:31 user nova-compute[75993]:   <features>
Nov 08 21:45:31 user nova-compute[75993]:     <acpi/>
Nov 08 21:45:31 user nova-compute[75993]:     <apic/>
Nov 08 21:45:31 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:45:31 user nova-compute[75993]:   </features>
Nov 08 21:45:31 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:45:31 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:45:31 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:45:31 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:45:31 user nova-compute[75993]:   </clock>
Nov 08 21:45:31 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:45:31 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:45:31 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:45:31 user nova-compute[75993]:   </cpu>
Nov 08 21:45:31 user nova-compute[75993]:   <devices>
Nov 08 21:45:31 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:45:31 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:45:31 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk"/>
Nov 08 21:45:31 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:45:31 user nova-compute[75993]:     </disk>
Nov 08 21:45:31 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:45:31 user nova-compute[75993]:       <mac address="fa:16:3e:4d:61:3f"/>
Nov 08 21:45:31 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:45:31 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:45:31 user nova-compute[75993]:       <target dev="tapf92989bc-c0"/>
Nov 08 21:45:31 user nova-compute[75993]:     </interface>
Nov 08 21:45:31 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:45:31 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/console.log" append="off"/>
Nov 08 21:45:31 user nova-compute[75993]:     </serial>
Nov 08 21:45:31 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:45:31 user nova-compute[75993]:     <video>
Nov 08 21:45:31 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:45:31 user nova-compute[75993]:     </video>
Nov 08 21:45:31 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:45:31 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:45:31 user nova-compute[75993]:     </rng>
Nov 08 21:45:31 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:45:31 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:45:31 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:45:31 user nova-compute[75993]:     </memballoon>
Nov 08 21:45:31 user nova-compute[75993]:   </devices>
Nov 08 21:45:31 user nova-compute[75993]: </domain>
Nov 08 21:45:31 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1190488140',display_name='tempest-TestServerVolumeAttachmentScenario-server-1190488140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1190488140',id=23,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdycmomWxn/irc4U5i3S8vmLTiBtjxOOE39w17t4ubtuIpBNjZvaBWRoyWc6lMzcu9Q1esy0WWCCLEkNl1gyR+FdEZGIPs4z/sLfssr9pl982re/lrOWkvNX64h3arK/A==',key_name='tempest-keypair-1880530491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='26368a5aad0648e197d89fb1b7d5f2ff',ramdisk_id='',reservation_id='r-00ly8usz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1317810676',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1317810676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:45:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666dbffed51d4b7baa09fd58c902d90b',uuid=cd48056d-13f0-4d8e-839e-0bd392c60478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f92989bc-c06f-4a11-a50d-5cd326889521", "address": "fa:16:3e:4d:61:3f", "network": {"id": "4e37144e-bc46-459b-b0ea-23789861dc06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1693242984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26368a5aad0648e197d89fb1b7d5f2ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92989bc-c0", "ovs_interfaceid": "f92989bc-c06f-4a11-a50d-5cd326889521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Converting VIF {"id": "f92989bc-c06f-4a11-a50d-5cd326889521", "address": "fa:16:3e:4d:61:3f", "network": {"id": "4e37144e-bc46-459b-b0ea-23789861dc06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1693242984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26368a5aad0648e197d89fb1b7d5f2ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92989bc-c0", "ovs_interfaceid": "f92989bc-c06f-4a11-a50d-5cd326889521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=f92989bc-c06f-4a11-a50d-5cd326889521,network=Network(4e37144e-bc46-459b-b0ea-23789861dc06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92989bc-c0') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG os_vif [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=f92989bc-c06f-4a11-a50d-5cd326889521,network=Network(4e37144e-bc46-459b-b0ea-23789861dc06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92989bc-c0') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20d8d5a7-44d2-5339-86fa-1ecf67aa834e', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:45:31 user nova-compute[75993]: INFO nova.compute.claims [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Claim successful on node user
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf92989bc-c0, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf92989bc-c0, col_values=(('qos', UUID('1fc63dbc-9b7c-454c-bc37-ca1ef9b701cb')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf92989bc-c0, col_values=(('external_ids', {'iface-id': 'f92989bc-c06f-4a11-a50d-5cd326889521', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:61:3f', 'vm-uuid': 'cd48056d-13f0-4d8e-839e-0bd392c60478'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:31 user nova-compute[75993]: INFO os_vif [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=f92989bc-c06f-4a11-a50d-5cd326889521,network=Network(4e37144e-bc46-459b-b0ea-23789861dc06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92989bc-c0')
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:45:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] No VIF found with MAC fa:16:3e:4d:61:3f, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance_info_cache with network_info: [{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Releasing lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.network.neutron [req-12cd20f1-b727-46f4-aba8-aa1ef1f2d2c6 req-2f9fea1d-fb94-4729-b6b6-2aa665558182 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Updated VIF entry in instance network info cache for port f92989bc-c06f-4a11-a50d-5cd326889521. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.network.neutron [req-12cd20f1-b727-46f4-aba8-aa1ef1f2d2c6 req-2f9fea1d-fb94-4729-b6b6-2aa665558182 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Updating instance_info_cache with network_info: [{"id": "f92989bc-c06f-4a11-a50d-5cd326889521", "address": "fa:16:3e:4d:61:3f", "network": {"id": "4e37144e-bc46-459b-b0ea-23789861dc06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1693242984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26368a5aad0648e197d89fb1b7d5f2ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92989bc-c0", "ovs_interfaceid": "f92989bc-c06f-4a11-a50d-5cd326889521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-12cd20f1-b727-46f4-aba8-aa1ef1f2d2c6 req-2f9fea1d-fb94-4729-b6b6-2aa665558182 service nova] Releasing lock "refresh_cache-cd48056d-13f0-4d8e-839e-0bd392c60478" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Starting migrate_disk_and_power_off {{(pid=75993) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.770s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:45:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:45:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.policy [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b330b61ef9cd48bdacbb7a7a695f34cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b942ec0575e4665a594614ccba455d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-912597ac-c66c-4f90-9b9c-c4a2f09bee62 req-6d8faa0a-38b1-4c24-9d1e-f8af2d32cd1d service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-unplugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-912597ac-c66c-4f90-9b9c-c4a2f09bee62 req-6d8faa0a-38b1-4c24-9d1e-f8af2d32cd1d service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-912597ac-c66c-4f90-9b9c-c4a2f09bee62 req-6d8faa0a-38b1-4c24-9d1e-f8af2d32cd1d service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-912597ac-c66c-4f90-9b9c-c4a2f09bee62 req-6d8faa0a-38b1-4c24-9d1e-f8af2d32cd1d service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-912597ac-c66c-4f90-9b9c-c4a2f09bee62 req-6d8faa0a-38b1-4c24-9d1e-f8af2d32cd1d service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-unplugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:32 user nova-compute[75993]: WARNING nova.compute.manager [req-912597ac-c66c-4f90-9b9c-c4a2f09bee62 req-6d8faa0a-38b1-4c24-9d1e-f8af2d32cd1d service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received unexpected event network-vif-unplugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with vm_state active and task_state resize_migrating.
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:45:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Creating image(s)
Nov 08 21:45:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "/opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "/opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.220s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.255s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk 1073741824" returned: 0 in 0.105s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.370s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Successfully created port: f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.202s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:33 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance destroyed successfully.
Nov 08 21:45:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1114912217',display_name='tempest-ServerActionsTestOtherB-server-1114912217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1114912217',id=16,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGWTKmgE74K9m4nW1Iy7drLyphNyDCWQasfONZutGXOVXbF1PlyC04hFpQCnQRFF8F4wUrmwbqu5NeLi338UFqYkZR8X28Kaoc+ZAStDMMSeZsea49hDL5j+Ud29ai6ZA==',key_name='tempest-keypair-19398814',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:41:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f53e802f4154acca8aa60dd0961a959',ramdisk_id='',reservation_id='r-5fh0kiuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900540301',owner_user_name='tempest-ServerActionsTestOtherB-1900540301-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:45:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b800131f464e52a3b4319038d1a23a',uuid=f828891c-fc9f-4d73-8467-2fa0a804ffb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1271773092-network", "vif_mac": "fa:16:3e:ed:c9:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converting VIF {"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1271773092-network", "vif_mac": "fa:16:3e:ed:c9:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG os_vif [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap787ea6de-46, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08060551-c097-47a9-99bf-89a8ba8888b4) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:33 user nova-compute[75993]: INFO os_vif [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46')
Nov 08 21:45:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELqlHWRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:45:33 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:45:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Cannot resize image /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Ensure instance console log exists: /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f23e9b-2695-48f6-a4c3-cbd379f2d85b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:45:33 user nova-compute[75993]: No targets found.
Nov 08 21:45:33 user nova-compute[75993]: iSNS:
Nov 08 21:45:33 user nova-compute[75993]: No targets found.
Nov 08 21:45:33 user nova-compute[75993]: STATIC:
Nov 08 21:45:33 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7
Nov 08 21:45:33 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:45:33 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:45:33 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0
Nov 08 21:45:33 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:45:33 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:45:33 user nova-compute[75993]: FIRMWARE:
Nov 08 21:45:33 user nova-compute[75993]: No targets found.
Nov 08 21:45:33 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:45:33 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:45:33 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1174950-8ca4-4df6-bc73-3985032e35c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[014eb46a-00e4-4c34-89e3-ac3445ffc179]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:45:34 user nova-compute[75993]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:45:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:45:34 user nova-compute[75993]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:45:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f858c2d3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[938090bf-a197-4580-9831-4d4b10f3dc24]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a6d1c5-5208-4a09-8e8b-2994df573d1e]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa91491e-38a7-4b40-8a9e-9d5e12598c53]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e20315-b233-46c9-869c-4b0c9fff9044]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19dbebd-2102-4e13-8b8c-5c847f89351e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-a6ef34ba-072f-4a9f-89ec-a7104cc0f331 req-06201853-9ce6-47cf-8c79-06304d7a0dd0 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Received event network-vif-plugged-f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a6ef34ba-072f-4a9f-89ec-a7104cc0f331 req-06201853-9ce6-47cf-8c79-06304d7a0dd0 service nova] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a6ef34ba-072f-4a9f-89ec-a7104cc0f331 req-06201853-9ce6-47cf-8c79-06304d7a0dd0 service nova] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a6ef34ba-072f-4a9f-89ec-a7104cc0f331 req-06201853-9ce6-47cf-8c79-06304d7a0dd0 service nova] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-a6ef34ba-072f-4a9f-89ec-a7104cc0f331 req-06201853-9ce6-47cf-8c79-06304d7a0dd0 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] No waiting events found dispatching network-vif-plugged-f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:34 user nova-compute[75993]: WARNING nova.compute.manager [req-a6ef34ba-072f-4a9f-89ec-a7104cc0f331 req-06201853-9ce6-47cf-8c79-06304d7a0dd0 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Received unexpected event network-vif-plugged-f92989bc-c06f-4a11-a50d-5cd326889521 for instance with vm_state building and task_state spawning.
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb08d701-9e17-4a0e-9671-e656d25e09d1]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]
Nov 08 21:45:34 user nova-compute[75993]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.
Nov 08 21:45:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e0837e-5351-4075-83ae-635c1830d090]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.436s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] <== disconnect_volume: return (438ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Successfully updated port: f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-fb106f6e-006d-4487-a003-1be51b9d9c99 req-fc6a54f5-b6ef-4888-a5bc-3fb3d6220900 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Received event network-changed-f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-fb106f6e-006d-4487-a003-1be51b9d9c99 req-fc6a54f5-b6ef-4888-a5bc-3fb3d6220900 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Refreshing instance network info cache due to event network-changed-f1990007-cd9f-4690-a4ab-b9db8ff871e3. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb106f6e-006d-4487-a003-1be51b9d9c99 req-fc6a54f5-b6ef-4888-a5bc-3fb3d6220900 service nova] Acquiring lock "refresh_cache-a3c86d97-9bc3-45a0-98da-9dbc56890b78" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb106f6e-006d-4487-a003-1be51b9d9c99 req-fc6a54f5-b6ef-4888-a5bc-3fb3d6220900 service nova] Acquired lock "refresh_cache-a3c86d97-9bc3-45a0-98da-9dbc56890b78" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-fb106f6e-006d-4487-a003-1be51b9d9c99 req-fc6a54f5-b6ef-4888-a5bc-3fb3d6220900 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Refreshing network info cache for port f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "refresh_cache-a3c86d97-9bc3-45a0-98da-9dbc56890b78" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-fb106f6e-006d-4487-a003-1be51b9d9c99 req-fc6a54f5-b6ef-4888-a5bc-3fb3d6220900 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0_resize/disk /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-fb106f6e-006d-4487-a003-1be51b9d9c99 req-fc6a54f5-b6ef-4888-a5bc-3fb3d6220900 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb106f6e-006d-4487-a003-1be51b9d9c99 req-fc6a54f5-b6ef-4888-a5bc-3fb3d6220900 service nova] Releasing lock "refresh_cache-a3c86d97-9bc3-45a0-98da-9dbc56890b78" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquired lock "refresh_cache-a3c86d97-9bc3-45a0-98da-9dbc56890b78" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-8d945159-cc32-494f-bbc5-9ee5c4bd9651 req-dad0d555-3683-4972-b5af-35c26a7a62eb service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8d945159-cc32-494f-bbc5-9ee5c4bd9651 req-dad0d555-3683-4972-b5af-35c26a7a62eb service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8d945159-cc32-494f-bbc5-9ee5c4bd9651 req-dad0d555-3683-4972-b5af-35c26a7a62eb service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8d945159-cc32-494f-bbc5-9ee5c4bd9651 req-dad0d555-3683-4972-b5af-35c26a7a62eb service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-8d945159-cc32-494f-bbc5-9ee5c4bd9651 req-dad0d555-3683-4972-b5af-35c26a7a62eb service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:34 user nova-compute[75993]: WARNING nova.compute.manager [req-8d945159-cc32-494f-bbc5-9ee5c4bd9651 req-dad0d555-3683-4972-b5af-35c26a7a62eb service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received unexpected event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with vm_state active and task_state resize_migrating.
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "cp -r /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0_resize/disk /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk" returned: 0 in 0.541s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0_resize/disk.info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk.info {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "cp -r /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0_resize/disk.info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk.info" returned: 0 in 0.046s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Updating instance_info_cache with network_info: [{"id": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "address": "fa:16:3e:8c:43:91", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1990007-cd", "ovs_interfaceid": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Releasing lock "refresh_cache-a3c86d97-9bc3-45a0-98da-9dbc56890b78" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Instance network_info: |[{"id": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "address": "fa:16:3e:8c:43:91", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1990007-cd", "ovs_interfaceid": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Start _get_guest_xml network_info=[{"id": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "address": "fa:16:3e:8c:43:91", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1990007-cd", "ovs_interfaceid": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:45:35 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:45:35 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-887136851',display_name='tempest-VolumesSnapshotTestJSON-instance-887136851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-887136851',id=24,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV4/dAnxbBBHPIf3Wod47YKbLsXWlvsPWhg99Z6ymTCpBlJ7/z8R/H2L4aDToPy+PK3+C8dbEdpShdp08W4jYnN/rQN3Hu7Rn7A1tn/AbVtxIiGfGVva7JmifuNtmWCZQ==',key_name='tempest-keypair-585481416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b942ec0575e4665a594614ccba455d3',ramdisk_id='',reservation_id='r-5wbgk0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072091596',owner_user_name='tempest-VolumesSnapshotTestJSON-1072091596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b330b61ef9cd48bdacbb7a7a695f34cb',uuid=a3c86d97-9bc3-45a0-98da-9dbc56890b78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "address": "fa:16:3e:8c:43:91", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1990007-cd", "ovs_interfaceid": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converting VIF {"id": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "address": "fa:16:3e:8c:43:91", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1990007-cd", "ovs_interfaceid": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:43:91,bridge_name='br-int',has_traffic_filtering=True,id=f1990007-cd9f-4690-a4ab-b9db8ff871e3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1990007-cd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.objects.instance [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lazy-loading 'pci_devices' on Instance uuid a3c86d97-9bc3-45a0-98da-9dbc56890b78 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:45:35 user nova-compute[75993]:   <uuid>a3c86d97-9bc3-45a0-98da-9dbc56890b78</uuid>
Nov 08 21:45:35 user nova-compute[75993]:   <name>instance-00000018</name>
Nov 08 21:45:35 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:45:35 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:45:35 user nova-compute[75993]:   <metadata>
Nov 08 21:45:35 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:45:35 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:45:35 user nova-compute[75993]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-887136851</nova:name>
Nov 08 21:45:35 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:45:35</nova:creationTime>
Nov 08 21:45:35 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:45:35 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:45:35 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:45:35 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:45:35 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:45:35 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:45:35 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:45:35 user nova-compute[75993]:       <nova:owner>
Nov 08 21:45:35 user nova-compute[75993]:         <nova:user uuid="b330b61ef9cd48bdacbb7a7a695f34cb">tempest-VolumesSnapshotTestJSON-1072091596-project-member</nova:user>
Nov 08 21:45:35 user nova-compute[75993]:         <nova:project uuid="0b942ec0575e4665a594614ccba455d3">tempest-VolumesSnapshotTestJSON-1072091596</nova:project>
Nov 08 21:45:35 user nova-compute[75993]:       </nova:owner>
Nov 08 21:45:35 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:45:35 user nova-compute[75993]:       <nova:ports>
Nov 08 21:45:35 user nova-compute[75993]:         <nova:port uuid="f1990007-cd9f-4690-a4ab-b9db8ff871e3">
Nov 08 21:45:35 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 21:45:35 user nova-compute[75993]:         </nova:port>
Nov 08 21:45:35 user nova-compute[75993]:       </nova:ports>
Nov 08 21:45:35 user nova-compute[75993]:     </nova:instance>
Nov 08 21:45:35 user nova-compute[75993]:   </metadata>
Nov 08 21:45:35 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:45:35 user nova-compute[75993]:     <system>
Nov 08 21:45:35 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:45:35 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:45:35 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:45:35 user nova-compute[75993]:       <entry name="serial">a3c86d97-9bc3-45a0-98da-9dbc56890b78</entry>
Nov 08 21:45:35 user nova-compute[75993]:       <entry name="uuid">a3c86d97-9bc3-45a0-98da-9dbc56890b78</entry>
Nov 08 21:45:35 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:45:35 user nova-compute[75993]:     </system>
Nov 08 21:45:35 user nova-compute[75993]:   </sysinfo>
Nov 08 21:45:35 user nova-compute[75993]:   <os>
Nov 08 21:45:35 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:45:35 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:45:35 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:45:35 user nova-compute[75993]:   </os>
Nov 08 21:45:35 user nova-compute[75993]:   <features>
Nov 08 21:45:35 user nova-compute[75993]:     <acpi/>
Nov 08 21:45:35 user nova-compute[75993]:     <apic/>
Nov 08 21:45:35 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:45:35 user nova-compute[75993]:   </features>
Nov 08 21:45:35 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:45:35 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:45:35 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:45:35 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:45:35 user nova-compute[75993]:   </clock>
Nov 08 21:45:35 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:45:35 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:45:35 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:45:35 user nova-compute[75993]:   </cpu>
Nov 08 21:45:35 user nova-compute[75993]:   <devices>
Nov 08 21:45:35 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:45:35 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:45:35 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk"/>
Nov 08 21:45:35 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:45:35 user nova-compute[75993]:     </disk>
Nov 08 21:45:35 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:45:35 user nova-compute[75993]:       <mac address="fa:16:3e:8c:43:91"/>
Nov 08 21:45:35 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:45:35 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:45:35 user nova-compute[75993]:       <target dev="tapf1990007-cd"/>
Nov 08 21:45:35 user nova-compute[75993]:     </interface>
Nov 08 21:45:35 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:45:35 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/console.log" append="off"/>
Nov 08 21:45:35 user nova-compute[75993]:     </serial>
Nov 08 21:45:35 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:45:35 user nova-compute[75993]:     <video>
Nov 08 21:45:35 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:45:35 user nova-compute[75993]:     </video>
Nov 08 21:45:35 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:45:35 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:45:35 user nova-compute[75993]:     </rng>
Nov 08 21:45:35 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:45:35 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:45:35 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:45:35 user nova-compute[75993]:     </memballoon>
Nov 08 21:45:35 user nova-compute[75993]:   </devices>
Nov 08 21:45:35 user nova-compute[75993]: </domain>
Nov 08 21:45:35 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-887136851',display_name='tempest-VolumesSnapshotTestJSON-instance-887136851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-887136851',id=24,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV4/dAnxbBBHPIf3Wod47YKbLsXWlvsPWhg99Z6ymTCpBlJ7/z8R/H2L4aDToPy+PK3+C8dbEdpShdp08W4jYnN/rQN3Hu7Rn7A1tn/AbVtxIiGfGVva7JmifuNtmWCZQ==',key_name='tempest-keypair-585481416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b942ec0575e4665a594614ccba455d3',ramdisk_id='',reservation_id='r-5wbgk0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072091596',owner_user_name='tempest-VolumesSnapshotTestJSON-1072091596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:45:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b330b61ef9cd48bdacbb7a7a695f34cb',uuid=a3c86d97-9bc3-45a0-98da-9dbc56890b78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "address": "fa:16:3e:8c:43:91", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1990007-cd", "ovs_interfaceid": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converting VIF {"id": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "address": "fa:16:3e:8c:43:91", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1990007-cd", "ovs_interfaceid": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:43:91,bridge_name='br-int',has_traffic_filtering=True,id=f1990007-cd9f-4690-a4ab-b9db8ff871e3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1990007-cd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG os_vif [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:43:91,bridge_name='br-int',has_traffic_filtering=True,id=f1990007-cd9f-4690-a4ab-b9db8ff871e3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1990007-cd') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea0b9fea-8a4d-5465-8bc9-73bd311fcd34', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1990007-cd, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1990007-cd, col_values=(('qos', UUID('b4e0f469-7a97-4523-a299-15825147799e')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1990007-cd, col_values=(('external_ids', {'iface-id': 'f1990007-cd9f-4690-a4ab-b9db8ff871e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:43:91', 'vm-uuid': 'a3c86d97-9bc3-45a0-98da-9dbc56890b78'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:35 user nova-compute[75993]: INFO os_vif [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:43:91,bridge_name='br-int',has_traffic_filtering=True,id=f1990007-cd9f-4690-a4ab-b9db8ff871e3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1990007-cd')
Nov 08 21:45:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:45:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] No VIF found with MAC fa:16:3e:8c:43:91, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:45:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Instance spawned successfully.
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-dd893ecc-6edc-4cdc-841d-ab3b82a1522d req-5877222d-e6ba-4cb5-b9d6-cf6f03ae9f38 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Received event network-vif-plugged-f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dd893ecc-6edc-4cdc-841d-ab3b82a1522d req-5877222d-e6ba-4cb5-b9d6-cf6f03ae9f38 service nova] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dd893ecc-6edc-4cdc-841d-ab3b82a1522d req-5877222d-e6ba-4cb5-b9d6-cf6f03ae9f38 service nova] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dd893ecc-6edc-4cdc-841d-ab3b82a1522d req-5877222d-e6ba-4cb5-b9d6-cf6f03ae9f38 service nova] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-dd893ecc-6edc-4cdc-841d-ab3b82a1522d req-5877222d-e6ba-4cb5-b9d6-cf6f03ae9f38 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] No waiting events found dispatching network-vif-plugged-f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:36 user nova-compute[75993]: WARNING nova.compute.manager [req-dd893ecc-6edc-4cdc-841d-ab3b82a1522d req-5877222d-e6ba-4cb5-b9d6-cf6f03ae9f38 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Received unexpected event network-vif-plugged-f92989bc-c06f-4a11-a50d-5cd326889521 for instance with vm_state building and task_state spawning.
Nov 08 21:45:36 user nova-compute[75993]: INFO nova.compute.manager [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Took 7.44 seconds to spawn the instance on the hypervisor.
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:45:36 user nova-compute[75993]: INFO nova.compute.manager [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Took 8.61 seconds to build instance.
Nov 08 21:45:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eec4b821-0077-4c4a-8a75-0f97f315a9f6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.732s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:36 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Port 787ea6de-4603-481a-8262-d51b1ed365da binding to destination host user is already ACTIVE {{(pid=75993) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquired lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:37 user nova-compute[75993]: INFO nova.compute.manager [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Terminating instance
Nov 08 21:45:37 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-84df1378-f13e-4cb4-a1cc-d840e71440d9 req-6c33ba80-2532-4d30-a7ec-153cab816236 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-unplugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-84df1378-f13e-4cb4-a1cc-d840e71440d9 req-6c33ba80-2532-4d30-a7ec-153cab816236 service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-84df1378-f13e-4cb4-a1cc-d840e71440d9 req-6c33ba80-2532-4d30-a7ec-153cab816236 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-84df1378-f13e-4cb4-a1cc-d840e71440d9 req-6c33ba80-2532-4d30-a7ec-153cab816236 service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-84df1378-f13e-4cb4-a1cc-d840e71440d9 req-6c33ba80-2532-4d30-a7ec-153cab816236 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-unplugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-84df1378-f13e-4cb4-a1cc-d840e71440d9 req-6c33ba80-2532-4d30-a7ec-153cab816236 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-unplugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance_info_cache with network_info: [{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Releasing lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Instance destroyed successfully.
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.objects.instance [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'resources' on Instance uuid 35ca9fea-481a-42ac-8558-c5140e71de59 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:34:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-69742388',display_name='tempest-AttachVolumeTestJSON-server-69742388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-69742388',id=4,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6oVnaQGjrVAmxsL/HSmftgrrbaB7fw/oPsVgbPjyOcbxzfpKxxWenMze7QWGbAaraNrcOiGtYnTUSvQT2S8k2jlnDmVZFkcsfxNh5h1CEZ87atD5chgSwK78UubB8vnQ==',key_name='tempest-keypair-1705684380',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:34:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-ufo08u5y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:43:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=35ca9fea-481a-42ac-8558-c5140e71de59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "address": "fa:16:3e:9e:8c:e8", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c7b1cf2-c7", "ovs_interfaceid": "8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG os_vif [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG os_brick.utils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c7b1cf2-c7, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[633029b3-1ac4-447e-8053-5779c06a4366]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31ad5ecb-e309-4f8e-a986-be011b1a33af) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:38 user nova-compute[75993]: INFO os_vif [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:8c:e8,bridge_name='br-int',has_traffic_filtering=True,id=8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c7b1cf2-c7')
Nov 08 21:45:38 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Deleting instance files /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59_del
Nov 08 21:45:38 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Deletion of /opt/stack/data/nova/instances/35ca9fea-481a-42ac-8558-c5140e71de59_del complete
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Received event network-vif-plugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] Acquiring lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] No waiting events found dispatching network-vif-plugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:38 user nova-compute[75993]: WARNING nova.compute.manager [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Received unexpected event network-vif-plugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 for instance with vm_state building and task_state spawning.
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Received event network-vif-plugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] Acquiring lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] No waiting events found dispatching network-vif-plugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:38 user nova-compute[75993]: WARNING nova.compute.manager [req-e0ecf2c1-1eaa-47a2-8928-8abc08968a13 req-630949bd-dcc7-4d9d-95c9-3c0e68343ac0 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Received unexpected event network-vif-plugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 for instance with vm_state building and task_state spawning.
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.035s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[016cf35f-ad76-4cc3-b981-7ced61cda785]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a9ea5c-dca9-4fa6-846b-11472add6156]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1583e3-379e-4f9a-8515-ea85592ce2ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:38 user nova-compute[75993]: INFO nova.compute.manager [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:45:38 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:45:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4c9282-a3af-413d-8242-a26183df532e]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:45:38 user nova-compute[75993]: DEBUG os_brick.utils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] <== get_connector_properties: return (239ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "cf0fc4d6-3e59-429f-863a-686865d3c977" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:39 user nova-compute[75993]: INFO nova.compute.manager [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Terminating instance
Nov 08 21:45:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-963aeb39-05ab-4c67-ae99-f7d3b03dbeac req-423f2f7b-875a-4df9-a5c6-f2fe4b674698 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Received event network-vif-unplugged-d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-963aeb39-05ab-4c67-ae99-f7d3b03dbeac req-423f2f7b-875a-4df9-a5c6-f2fe4b674698 service nova] Acquiring lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-963aeb39-05ab-4c67-ae99-f7d3b03dbeac req-423f2f7b-875a-4df9-a5c6-f2fe4b674698 service nova] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-963aeb39-05ab-4c67-ae99-f7d3b03dbeac req-423f2f7b-875a-4df9-a5c6-f2fe4b674698 service nova] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-963aeb39-05ab-4c67-ae99-f7d3b03dbeac req-423f2f7b-875a-4df9-a5c6-f2fe4b674698 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] No waiting events found dispatching network-vif-unplugged-d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-963aeb39-05ab-4c67-ae99-f7d3b03dbeac req-423f2f7b-875a-4df9-a5c6-f2fe4b674698 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Received event network-vif-unplugged-d91898a8-7a2c-4438-8187-6948a8e41853 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:45:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:45:39 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Instance spawned successfully.
Nov 08 21:45:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:45:40 user nova-compute[75993]: INFO nova.compute.manager [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Took 7.29 seconds to spawn the instance on the hypervisor.
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-c060827c-68c4-43ae-b900-848cb3ded710 req-a9ca1917-0b81-4340-a0c1-f19d0fbe474c service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c060827c-68c4-43ae-b900-848cb3ded710 req-a9ca1917-0b81-4340-a0c1-f19d0fbe474c service nova] Acquiring lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c060827c-68c4-43ae-b900-848cb3ded710 req-a9ca1917-0b81-4340-a0c1-f19d0fbe474c service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c060827c-68c4-43ae-b900-848cb3ded710 req-a9ca1917-0b81-4340-a0c1-f19d0fbe474c service nova] Lock "35ca9fea-481a-42ac-8558-c5140e71de59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-c060827c-68c4-43ae-b900-848cb3ded710 req-a9ca1917-0b81-4340-a0c1-f19d0fbe474c service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] No waiting events found dispatching network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:40 user nova-compute[75993]: WARNING nova.compute.manager [req-c060827c-68c4-43ae-b900-848cb3ded710 req-a9ca1917-0b81-4340-a0c1-f19d0fbe474c service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received unexpected event network-vif-plugged-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 for instance with vm_state active and task_state deleting.
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:45:40 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Instance destroyed successfully.
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.objects.instance [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lazy-loading 'resources' on Instance uuid cf0fc4d6-3e59-429f-863a-686865d3c977 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:45:40 user nova-compute[75993]: INFO nova.compute.manager [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Took 8.88 seconds to build instance.
Nov 08 21:45:40 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Took 1.95 seconds to deallocate network for instance.
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:43:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-753632063',display_name='tempest-VolumesActionsTest-instance-753632063',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-753632063',id=22,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:43:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93a324eff68a4f3ebbf73ca83664e50b',ramdisk_id='',reservation_id='r-2qvz22qq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1465914463',owner_user_name='tempest-VolumesActionsTest-1465914463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:43:56Z,user_data=None,user_id='f7ce4dd5fa2e4dbfbc817e77249680c7',uuid=cf0fc4d6-3e59-429f-863a-686865d3c977,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d91898a8-7a2c-4438-8187-6948a8e41853", "address": "fa:16:3e:28:92:7e", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91898a8-7a", "ovs_interfaceid": "d91898a8-7a2c-4438-8187-6948a8e41853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converting VIF {"id": "d91898a8-7a2c-4438-8187-6948a8e41853", "address": "fa:16:3e:28:92:7e", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd91898a8-7a", "ovs_interfaceid": "d91898a8-7a2c-4438-8187-6948a8e41853", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:92:7e,bridge_name='br-int',has_traffic_filtering=True,id=d91898a8-7a2c-4438-8187-6948a8e41853,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91898a8-7a') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG os_vif [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:92:7e,bridge_name='br-int',has_traffic_filtering=True,id=d91898a8-7a2c-4438-8187-6948a8e41853,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91898a8-7a') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd91898a8-7a, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d2f41b5-e35b-429a-90b2-e7fc98e41737) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:40 user nova-compute[75993]: INFO os_vif [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:92:7e,bridge_name='br-int',has_traffic_filtering=True,id=d91898a8-7a2c-4438-8187-6948a8e41853,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd91898a8-7a')
Nov 08 21:45:40 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Deleting instance files /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977_del
Nov 08 21:45:40 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Deletion of /opt/stack/data/nova/instances/cf0fc4d6-3e59-429f-863a-686865d3c977_del complete
Nov 08 21:45:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d9d8b6b7-f54f-4aa9-9933-0a5eee17afc3 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.052s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:40 user nova-compute[75993]: INFO nova.compute.manager [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 08 21:45:40 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:45:40 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:45:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:41 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:45:41 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:45:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.590s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:41 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Deleted allocations for instance 35ca9fea-481a-42ac-8558-c5140e71de59
Nov 08 21:45:41 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:45:41 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Took 0.73 seconds to deallocate network for instance.
Nov 08 21:45:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c3be0e38-819d-4666-8a75-bd9bf0e4a378 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "35ca9fea-481a-42ac-8558-c5140e71de59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.979s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-137b70bf-0dba-490c-94ad-9716994ea5b0 req-d3a14931-7edc-4066-9574-2c6052ee7286 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Received event network-vif-plugged-d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-137b70bf-0dba-490c-94ad-9716994ea5b0 req-d3a14931-7edc-4066-9574-2c6052ee7286 service nova] Acquiring lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-137b70bf-0dba-490c-94ad-9716994ea5b0 req-d3a14931-7edc-4066-9574-2c6052ee7286 service nova] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-137b70bf-0dba-490c-94ad-9716994ea5b0 req-d3a14931-7edc-4066-9574-2c6052ee7286 service nova] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-137b70bf-0dba-490c-94ad-9716994ea5b0 req-d3a14931-7edc-4066-9574-2c6052ee7286 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] No waiting events found dispatching network-vif-plugged-d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:45:41 user nova-compute[75993]: WARNING nova.compute.manager [req-137b70bf-0dba-490c-94ad-9716994ea5b0 req-d3a14931-7edc-4066-9574-2c6052ee7286 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Received unexpected event network-vif-plugged-d91898a8-7a2c-4438-8187-6948a8e41853 for instance with vm_state deleted and task_state None.
Nov 08 21:45:42 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:45:42 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:45:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.490s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:42 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Deleted allocations for instance cf0fc4d6-3e59-429f-863a-686865d3c977
Nov 08 21:45:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d4e902b6-0f10-4a15-90b2-54663122c051 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "cf0fc4d6-3e59-429f-863a-686865d3c977" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.875s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-577901b6-af4b-43e9-8bd8-5fdc018919b9 req-8d04aac6-fb0e-4e86-a81d-0f1f75b2c7d5 service nova] [instance: 35ca9fea-481a-42ac-8558-c5140e71de59] Received event network-vif-deleted-8c7b1cf2-c70d-4e6c-bee3-2c25327a91a2 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-577901b6-af4b-43e9-8bd8-5fdc018919b9 req-8d04aac6-fb0e-4e86-a81d-0f1f75b2c7d5 service nova] [instance: cf0fc4d6-3e59-429f-863a-686865d3c977] Received event network-vif-deleted-d91898a8-7a2c-4438-8187-6948a8e41853 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:45:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:45:44 user nova-compute[75993]: INFO nova.compute.claims [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Claim successful on node user
Nov 08 21:45:45 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:45:45 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:45:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:45:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:45:45 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:45:45 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:45:45 user nova-compute[75993]: DEBUG nova.policy [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78965be8230646288b7fc0443c3f4f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1547c59f8e4d85ad6f650b01243357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:45:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:45:45 user nova-compute[75993]: INFO nova.virt.block_device [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Booting with blank volume at /dev/vda
Nov 08 21:45:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:46 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Successfully created port: 6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:45:46 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Successfully updated port: 6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:45:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:45:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquired lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:45:46 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:45:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-ba3073a1-0cec-4266-9165-277e263da1ae req-be68c1fe-7b37-4e9e-8973-c466154520e3 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-changed-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:45:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-ba3073a1-0cec-4266-9165-277e263da1ae req-be68c1fe-7b37-4e9e-8973-c466154520e3 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Refreshing instance network info cache due to event network-changed-6e1733d1-86b8-4b78-b2a1-830ac109f583. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:45:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ba3073a1-0cec-4266-9165-277e263da1ae req-be68c1fe-7b37-4e9e-8973-c466154520e3 service nova] Acquiring lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:45:46 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:45:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updating instance_info_cache with network_info: [{"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:45:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Releasing lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:45:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Instance network_info: |[{"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:45:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ba3073a1-0cec-4266-9165-277e263da1ae req-be68c1fe-7b37-4e9e-8973-c466154520e3 service nova] Acquired lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:45:47 user nova-compute[75993]: DEBUG nova.network.neutron [req-ba3073a1-0cec-4266-9165-277e263da1ae req-be68c1fe-7b37-4e9e-8973-c466154520e3 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Refreshing network info cache for port 6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:45:47 user nova-compute[75993]: DEBUG nova.network.neutron [req-ba3073a1-0cec-4266-9165-277e263da1ae req-be68c1fe-7b37-4e9e-8973-c466154520e3 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updated VIF entry in instance network info cache for port 6e1733d1-86b8-4b78-b2a1-830ac109f583. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:45:47 user nova-compute[75993]: DEBUG nova.network.neutron [req-ba3073a1-0cec-4266-9165-277e263da1ae req-be68c1fe-7b37-4e9e-8973-c466154520e3 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updating instance_info_cache with network_info: [{"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:45:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ba3073a1-0cec-4266-9165-277e263da1ae req-be68c1fe-7b37-4e9e-8973-c466154520e3 service nova] Releasing lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:45:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:45:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:45:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:45:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 21:45:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:45:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG os_brick.utils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0554cebd-e905-442e-a599-99dc0f620773]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb77711c-1ce1-42ba-825a-5478fae8b7ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[774084d8-e4f2-4b3f-be42-0d42488a3a7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fd90eb-0c0b-4c90-a9a0-e6c39209d008]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:45:56 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c49a70-45cc-48d1-970f-e53c3a3a022f]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG os_brick.utils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updating existing volume attachment record: db5542db-be9b-4267-b9b3-e7a84dccfbc9 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:45:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:45:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:45:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:45:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:45:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:45:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:45:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:45:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:45:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:45:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:02 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:46:03 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:03 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7571MB free_disk=25.160919189453125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Applying migration context for instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 as it has an incoming, in-progress migration 7b299dd2-f2e1-4642-a3a8-a15f0ed5130b. Migration status is post-migrating {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 21:46:03 user nova-compute[75993]: INFO nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating resource usage from migration 7b299dd2-f2e1-4642-a3a8-a15f0ed5130b
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance cd48056d-13f0-4d8e-839e-0bd392c60478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Migration 7b299dd2-f2e1-4642-a3a8-a15f0ed5130b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance a3c86d97-9bc3-45a0-98da-9dbc56890b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Starting finish_migration {{(pid=75993) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance directory exists: not creating {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 21:46:03 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Creating image(s)
Nov 08 21:46:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.171s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk. size=21474836480 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:46:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk 21474836480 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk 21474836480" returned: 0 in 0.060s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Ensure instance console log exists: /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Start _get_guest_xml network_info=[{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1271773092-network", "vif_mac": "fa:16:3e:ed:c9:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '1154f4b7-01ec-4750-ae37-05e3c693eece', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELqlHWRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f828891c-fc9f-4d73-8467-2fa0a804ffb0', 'attached_at': '2023-11-08T21:46:03.000000', 'detached_at': '', 'volume_id': '5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'serial': '5aecdf48-bd8b-4f46-acc9-012c71b590f0'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:46:04 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:04 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELqlHWRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:46:04 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:46:04 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:46:04 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4a00ca-0d79-41f0-bd49-948220f3450f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:46:04 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6104612-058f-414b-987e-49874607f4d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0] added
Nov 08 21:46:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5805208d-aefc-4469-bd92-31a596e48cd3]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a88abe6-ebe2-4a9a-bd0d-b2f68fe79300]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELqlHWRP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELqlHWRP" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44884c9-3ea4-4f7a-b3e1-345a8b5b3bca]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELqlHWRP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae318fe-1d77-42f9-9e18-b1fe10dadf09]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da4e1cb-1025-475d-983c-1130aa989e18]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:46:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:46:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edd4d9a-5138-432d-abb1-3e8f74b70f30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]
Nov 08 21:46:04 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.
Nov 08 21:46:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5938fe04-9964-4913-b6e3-ab2bfe2aac4d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29aea4e-4120-427c-9cc6-995da285b817]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:46:04 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:46:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:46:04 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:46:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[074829b8-d6d4-41f7-bd85-31975e9c9ce6]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:46:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELqlHWRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26461333534623164', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461333534623164', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1114912217',display_name='tempest-ServerActionsTestOtherB-server-1114912217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1114912217',id=16,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGWTKmgE74K9m4nW1Iy7drLyphNyDCWQasfONZutGXOVXbF1PlyC04hFpQCnQRFF8F4wUrmwbqu5NeLi338UFqYkZR8X28Kaoc+ZAStDMMSeZsea49hDL5j+Ud29ai6ZA==',key_name='tempest-keypair-19398814',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:41:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f53e802f4154acca8aa60dd0961a959',ramdisk_id='',reservation_id='r-5fh0kiuj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900540301',owner_user_name='tempest-ServerActionsTestOtherB-1900540301-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:45:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b800131f464e52a3b4319038d1a23a',uuid=f828891c-fc9f-4d73-8467-2fa0a804ffb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1271773092-network", "vif_mac": "fa:16:3e:ed:c9:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converting VIF {"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1271773092-network", "vif_mac": "fa:16:3e:ed:c9:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:46:05 user nova-compute[75993]:   <uuid>f828891c-fc9f-4d73-8467-2fa0a804ffb0</uuid>
Nov 08 21:46:05 user nova-compute[75993]:   <name>instance-00000010</name>
Nov 08 21:46:05 user nova-compute[75993]:   <memory>2097152</memory>
Nov 08 21:46:05 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:46:05 user nova-compute[75993]:   <metadata>
Nov 08 21:46:05 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:46:05 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:46:05 user nova-compute[75993]:       <nova:name>tempest-ServerActionsTestOtherB-server-1114912217</nova:name>
Nov 08 21:46:05 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:46:04</nova:creationTime>
Nov 08 21:46:05 user nova-compute[75993]:       <nova:flavor name="m1.small">
Nov 08 21:46:05 user nova-compute[75993]:         <nova:memory>2048</nova:memory>
Nov 08 21:46:05 user nova-compute[75993]:         <nova:disk>20</nova:disk>
Nov 08 21:46:05 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:46:05 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:46:05 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:46:05 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:46:05 user nova-compute[75993]:       <nova:owner>
Nov 08 21:46:05 user nova-compute[75993]:         <nova:user uuid="80b800131f464e52a3b4319038d1a23a">tempest-ServerActionsTestOtherB-1900540301-project-member</nova:user>
Nov 08 21:46:05 user nova-compute[75993]:         <nova:project uuid="3f53e802f4154acca8aa60dd0961a959">tempest-ServerActionsTestOtherB-1900540301</nova:project>
Nov 08 21:46:05 user nova-compute[75993]:       </nova:owner>
Nov 08 21:46:05 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:46:05 user nova-compute[75993]:       <nova:ports>
Nov 08 21:46:05 user nova-compute[75993]:         <nova:port uuid="787ea6de-4603-481a-8262-d51b1ed365da">
Nov 08 21:46:05 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 21:46:05 user nova-compute[75993]:         </nova:port>
Nov 08 21:46:05 user nova-compute[75993]:       </nova:ports>
Nov 08 21:46:05 user nova-compute[75993]:     </nova:instance>
Nov 08 21:46:05 user nova-compute[75993]:   </metadata>
Nov 08 21:46:05 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:46:05 user nova-compute[75993]:     <system>
Nov 08 21:46:05 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:46:05 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:46:05 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:46:05 user nova-compute[75993]:       <entry name="serial">f828891c-fc9f-4d73-8467-2fa0a804ffb0</entry>
Nov 08 21:46:05 user nova-compute[75993]:       <entry name="uuid">f828891c-fc9f-4d73-8467-2fa0a804ffb0</entry>
Nov 08 21:46:05 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:46:05 user nova-compute[75993]:     </system>
Nov 08 21:46:05 user nova-compute[75993]:   </sysinfo>
Nov 08 21:46:05 user nova-compute[75993]:   <os>
Nov 08 21:46:05 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:46:05 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:46:05 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:46:05 user nova-compute[75993]:   </os>
Nov 08 21:46:05 user nova-compute[75993]:   <features>
Nov 08 21:46:05 user nova-compute[75993]:     <acpi/>
Nov 08 21:46:05 user nova-compute[75993]:     <apic/>
Nov 08 21:46:05 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:46:05 user nova-compute[75993]:   </features>
Nov 08 21:46:05 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:46:05 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:46:05 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:46:05 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:46:05 user nova-compute[75993]:   </clock>
Nov 08 21:46:05 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:46:05 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:46:05 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:46:05 user nova-compute[75993]:   </cpu>
Nov 08 21:46:05 user nova-compute[75993]:   <devices>
Nov 08 21:46:05 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:46:05 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:46:05 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk"/>
Nov 08 21:46:05 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:46:05 user nova-compute[75993]:     </disk>
Nov 08 21:46:05 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:46:05 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:46:05 user nova-compute[75993]:       <source dev="/dev/sdc"/>
Nov 08 21:46:05 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:46:05 user nova-compute[75993]:       <serial>5aecdf48-bd8b-4f46-acc9-012c71b590f0</serial>
Nov 08 21:46:05 user nova-compute[75993]:     </disk>
Nov 08 21:46:05 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:46:05 user nova-compute[75993]:       <mac address="fa:16:3e:ed:c9:e3"/>
Nov 08 21:46:05 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:46:05 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:46:05 user nova-compute[75993]:       <target dev="tap787ea6de-46"/>
Nov 08 21:46:05 user nova-compute[75993]:     </interface>
Nov 08 21:46:05 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:46:05 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/console.log" append="off"/>
Nov 08 21:46:05 user nova-compute[75993]:     </serial>
Nov 08 21:46:05 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:46:05 user nova-compute[75993]:     <video>
Nov 08 21:46:05 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:46:05 user nova-compute[75993]:     </video>
Nov 08 21:46:05 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:46:05 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:46:05 user nova-compute[75993]:     </rng>
Nov 08 21:46:05 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:46:05 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:46:05 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:46:05 user nova-compute[75993]:     </memballoon>
Nov 08 21:46:05 user nova-compute[75993]:   </devices>
Nov 08 21:46:05 user nova-compute[75993]: </domain>
Nov 08 21:46:05 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1114912217',display_name='tempest-ServerActionsTestOtherB-server-1114912217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1114912217',id=16,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGWTKmgE74K9m4nW1Iy7drLyphNyDCWQasfONZutGXOVXbF1PlyC04hFpQCnQRFF8F4wUrmwbqu5NeLi338UFqYkZR8X28Kaoc+ZAStDMMSeZsea49hDL5j+Ud29ai6ZA==',key_name='tempest-keypair-19398814',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:41:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f53e802f4154acca8aa60dd0961a959',ramdisk_id='',reservation_id='r-5fh0kiuj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900540301',owner_user_name='tempest-ServerActionsTestOtherB-1900540301-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:45:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b800131f464e52a3b4319038d1a23a',uuid=f828891c-fc9f-4d73-8467-2fa0a804ffb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1271773092-network", "vif_mac": "fa:16:3e:ed:c9:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converting VIF {"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1271773092-network", "vif_mac": "fa:16:3e:ed:c9:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG os_vif [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67636169-554c-564b-8308-221a0647e372', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap787ea6de-46, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap787ea6de-46, col_values=(('qos', UUID('d1d46c2e-1bae-4db2-a874-23333d87d3cd')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap787ea6de-46, col_values=(('external_ids', {'iface-id': '787ea6de-4603-481a-8262-d51b1ed365da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:c9:e3', 'vm-uuid': 'f828891c-fc9f-4d73-8467-2fa0a804ffb0'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:05 user nova-compute[75993]: INFO os_vif [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46')
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] No VIF found with MAC fa:16:3e:ed:c9:e3, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:46:05 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:46:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-dc8d3caa-c348-4d29-b9d7-2e06a71fcff8 req-ab571673-5d4b-4319-9070-9a9fbd60753c service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dc8d3caa-c348-4d29-b9d7-2e06a71fcff8 req-ab571673-5d4b-4319-9070-9a9fbd60753c service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dc8d3caa-c348-4d29-b9d7-2e06a71fcff8 req-ab571673-5d4b-4319-9070-9a9fbd60753c service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dc8d3caa-c348-4d29-b9d7-2e06a71fcff8 req-ab571673-5d4b-4319-9070-9a9fbd60753c service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-dc8d3caa-c348-4d29-b9d7-2e06a71fcff8 req-ab571673-5d4b-4319-9070-9a9fbd60753c service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:46:07 user nova-compute[75993]: WARNING nova.compute.manager [req-dc8d3caa-c348-4d29-b9d7-2e06a71fcff8 req-ab571673-5d4b-4319-9070-9a9fbd60753c service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received unexpected event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with vm_state active and task_state resize_finish.
Nov 08 21:46:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:46:09 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance running successfully.
Nov 08 21:46:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Failed to set time: agent not configured {{(pid=75993) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 21:46:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f723b27f-f1ff-47d5-96bb-583d2f22666b tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] finish_migration finished successfully. {{(pid=75993) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 21:46:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-ddcc4193-fb8f-4209-b891-8add7b7c3d40 req-82f6a49f-3644-4b58-a37c-d5f690f58395 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ddcc4193-fb8f-4209-b891-8add7b7c3d40 req-82f6a49f-3644-4b58-a37c-d5f690f58395 service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ddcc4193-fb8f-4209-b891-8add7b7c3d40 req-82f6a49f-3644-4b58-a37c-d5f690f58395 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ddcc4193-fb8f-4209-b891-8add7b7c3d40 req-82f6a49f-3644-4b58-a37c-d5f690f58395 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-ddcc4193-fb8f-4209-b891-8add7b7c3d40 req-82f6a49f-3644-4b58-a37c-d5f690f58395 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:46:09 user nova-compute[75993]: WARNING nova.compute.manager [req-ddcc4193-fb8f-4209-b891-8add7b7c3d40 req-82f6a49f-3644-4b58-a37c-d5f690f58395 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received unexpected event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with vm_state active and task_state resize_finish.
Nov 08 21:46:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:46:20 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Creating image(s)
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Ensure instance console log exists: /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Start _get_guest_xml network_info=[{"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'db5542db-be9b-4267-b9b3-e7a84dccfbc9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLxGMFWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64d8c15c-0ac9-434b-852a-123a940dc0ae', 'attached_at': '', 'detached_at': '', 'volume_id': '567f6f9e-3314-4f87-853f-7786f54a9ab3', 'serial': '567f6f9e-3314-4f87-853f-7786f54a9ab3'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:46:20 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:20 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLxGMFWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:46:20 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:46:20 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:46:20 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bba74a-8030-443d-a062-6aa8c3985f50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:46:20 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[077457ed-dc3e-4965-a491-863a05a1af7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3] added
Nov 08 21:46:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bc3d13-27ae-4a5e-9c67-77fbfcf5d34f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8135c11-1166-4f6a-8b58-39e4abd3d2c0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLxGMFWg {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLxGMFWg" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[df03a13b-8407-4cab-b2e6-d5b113ee5533]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TLxGMFWg'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[864839a2-4814-4a76-956b-4f027601f7fd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b7a2d7-0021-412a-a539-9f0f0a85d071]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:46:20 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:46:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:46:20 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:46:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ae1d89-f560-4af0-b9b5-53521a8cde86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3, portal: 172.16.0.220,3260]
Nov 08 21:46:20 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3, portal: 172.16.0.220,3260] successful.
Nov 08 21:46:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1895c88-31c0-486b-b9af-efd9f6a72d71]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dcd0c1-f5b5-49ef-82e7-db63fd917038]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:46:20 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:46:20 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:46:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:46:20 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:46:20 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:46:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f7ed8c-9909-467e-91d8-1c0b0521402a]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLxGMFWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:46:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23663633063356237', 'path': '/dev/sdd'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663633063356237', 'path': '/dev/sdd'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1354744541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1354744541',id=25,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-ekc9sy6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:45:45Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=64d8c15c-0ac9-434b-852a-123a940dc0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6e:60,bridge_name='br-int',has_traffic_filtering=True,id=6e1733d1-86b8-4b78-b2a1-830ac109f583,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e1733d1-86') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG nova.objects.instance [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'pci_devices' on Instance uuid 64d8c15c-0ac9-434b-852a-123a940dc0ae {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:46:21 user nova-compute[75993]:   <uuid>64d8c15c-0ac9-434b-852a-123a940dc0ae</uuid>
Nov 08 21:46:21 user nova-compute[75993]:   <name>instance-00000019</name>
Nov 08 21:46:21 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:46:21 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:46:21 user nova-compute[75993]:   <metadata>
Nov 08 21:46:21 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:46:21 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:46:21 user nova-compute[75993]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1354744541</nova:name>
Nov 08 21:46:21 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:46:20</nova:creationTime>
Nov 08 21:46:21 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:46:21 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:46:21 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:46:21 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:46:21 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:46:21 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:46:21 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:46:21 user nova-compute[75993]:       <nova:owner>
Nov 08 21:46:21 user nova-compute[75993]:         <nova:user uuid="78965be8230646288b7fc0443c3f4f6c">tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member</nova:user>
Nov 08 21:46:21 user nova-compute[75993]:         <nova:project uuid="fb1547c59f8e4d85ad6f650b01243357">tempest-ServerBootFromVolumeStableRescueTest-571934265</nova:project>
Nov 08 21:46:21 user nova-compute[75993]:       </nova:owner>
Nov 08 21:46:21 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:46:21 user nova-compute[75993]:       <nova:ports>
Nov 08 21:46:21 user nova-compute[75993]:         <nova:port uuid="6e1733d1-86b8-4b78-b2a1-830ac109f583">
Nov 08 21:46:21 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 21:46:21 user nova-compute[75993]:         </nova:port>
Nov 08 21:46:21 user nova-compute[75993]:       </nova:ports>
Nov 08 21:46:21 user nova-compute[75993]:     </nova:instance>
Nov 08 21:46:21 user nova-compute[75993]:   </metadata>
Nov 08 21:46:21 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:46:21 user nova-compute[75993]:     <system>
Nov 08 21:46:21 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:46:21 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:46:21 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:46:21 user nova-compute[75993]:       <entry name="serial">64d8c15c-0ac9-434b-852a-123a940dc0ae</entry>
Nov 08 21:46:21 user nova-compute[75993]:       <entry name="uuid">64d8c15c-0ac9-434b-852a-123a940dc0ae</entry>
Nov 08 21:46:21 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:46:21 user nova-compute[75993]:     </system>
Nov 08 21:46:21 user nova-compute[75993]:   </sysinfo>
Nov 08 21:46:21 user nova-compute[75993]:   <os>
Nov 08 21:46:21 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:46:21 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:46:21 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:46:21 user nova-compute[75993]:   </os>
Nov 08 21:46:21 user nova-compute[75993]:   <features>
Nov 08 21:46:21 user nova-compute[75993]:     <acpi/>
Nov 08 21:46:21 user nova-compute[75993]:     <apic/>
Nov 08 21:46:21 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:46:21 user nova-compute[75993]:   </features>
Nov 08 21:46:21 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:46:21 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:46:21 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:46:21 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:46:21 user nova-compute[75993]:   </clock>
Nov 08 21:46:21 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:46:21 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:46:21 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:46:21 user nova-compute[75993]:   </cpu>
Nov 08 21:46:21 user nova-compute[75993]:   <devices>
Nov 08 21:46:21 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:46:21 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:46:21 user nova-compute[75993]:       <source dev="/dev/sdd"/>
Nov 08 21:46:21 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:46:21 user nova-compute[75993]:       <serial>567f6f9e-3314-4f87-853f-7786f54a9ab3</serial>
Nov 08 21:46:21 user nova-compute[75993]:     </disk>
Nov 08 21:46:21 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:46:21 user nova-compute[75993]:       <mac address="fa:16:3e:5e:6e:60"/>
Nov 08 21:46:21 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:46:21 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:46:21 user nova-compute[75993]:       <target dev="tap6e1733d1-86"/>
Nov 08 21:46:21 user nova-compute[75993]:     </interface>
Nov 08 21:46:21 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:46:21 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/console.log" append="off"/>
Nov 08 21:46:21 user nova-compute[75993]:     </serial>
Nov 08 21:46:21 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:46:21 user nova-compute[75993]:     <video>
Nov 08 21:46:21 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:46:21 user nova-compute[75993]:     </video>
Nov 08 21:46:21 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:46:21 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:46:21 user nova-compute[75993]:     </rng>
Nov 08 21:46:21 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:46:21 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:46:21 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:46:21 user nova-compute[75993]:     </memballoon>
Nov 08 21:46:21 user nova-compute[75993]:   </devices>
Nov 08 21:46:21 user nova-compute[75993]: </domain>
Nov 08 21:46:21 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1354744541',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1354744541',id=25,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-ekc9sy6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:45:45Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=64d8c15c-0ac9-434b-852a-123a940dc0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6e:60,bridge_name='br-int',has_traffic_filtering=True,id=6e1733d1-86b8-4b78-b2a1-830ac109f583,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e1733d1-86') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG os_vif [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6e:60,bridge_name='br-int',has_traffic_filtering=True,id=6e1733d1-86b8-4b78-b2a1-830ac109f583,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e1733d1-86') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99d56392-e31b-5845-8b05-77fd3efeeb9f', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e1733d1-86, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e1733d1-86, col_values=(('qos', UUID('5fba2e50-cbb7-42eb-9339-da45e59637f5')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e1733d1-86, col_values=(('external_ids', {'iface-id': '6e1733d1-86b8-4b78-b2a1-830ac109f583', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:6e:60', 'vm-uuid': '64d8c15c-0ac9-434b-852a-123a940dc0ae'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:21 user nova-compute[75993]: INFO os_vif [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:6e:60,bridge_name='br-int',has_traffic_filtering=True,id=6e1733d1-86b8-4b78-b2a1-830ac109f583,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e1733d1-86')
Nov 08 21:46:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:46:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No VIF found with MAC fa:16:3e:5e:6e:60, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:46:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-0a5bafae-a915-4306-b7cd-91a0fa492797 req-77a7cbce-c37e-4acf-a513-5c8df20a58a7 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0a5bafae-a915-4306-b7cd-91a0fa492797 req-77a7cbce-c37e-4acf-a513-5c8df20a58a7 service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0a5bafae-a915-4306-b7cd-91a0fa492797 req-77a7cbce-c37e-4acf-a513-5c8df20a58a7 service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0a5bafae-a915-4306-b7cd-91a0fa492797 req-77a7cbce-c37e-4acf-a513-5c8df20a58a7 service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-0a5bafae-a915-4306-b7cd-91a0fa492797 req-77a7cbce-c37e-4acf-a513-5c8df20a58a7 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:46:23 user nova-compute[75993]: WARNING nova.compute.manager [req-0a5bafae-a915-4306-b7cd-91a0fa492797 req-77a7cbce-c37e-4acf-a513-5c8df20a58a7 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received unexpected event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with vm_state building and task_state spawning.
Nov 08 21:46:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:46:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:46:24 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Instance spawned successfully.
Nov 08 21:46:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:46:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:25 user nova-compute[75993]: INFO nova.compute.manager [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Took 4.99 seconds to spawn the instance on the hypervisor.
Nov 08 21:46:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:46:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-dc89e303-f078-4cac-b2d6-751ba4c07df2 req-7ebd266e-83d4-4646-a037-2c00379deba3 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dc89e303-f078-4cac-b2d6-751ba4c07df2 req-7ebd266e-83d4-4646-a037-2c00379deba3 service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dc89e303-f078-4cac-b2d6-751ba4c07df2 req-7ebd266e-83d4-4646-a037-2c00379deba3 service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dc89e303-f078-4cac-b2d6-751ba4c07df2 req-7ebd266e-83d4-4646-a037-2c00379deba3 service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-dc89e303-f078-4cac-b2d6-751ba4c07df2 req-7ebd266e-83d4-4646-a037-2c00379deba3 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:46:25 user nova-compute[75993]: WARNING nova.compute.manager [req-dc89e303-f078-4cac-b2d6-751ba4c07df2 req-7ebd266e-83d4-4646-a037-2c00379deba3 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received unexpected event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with vm_state building and task_state spawning.
Nov 08 21:46:25 user nova-compute[75993]: INFO nova.compute.manager [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Took 40.51 seconds to build instance.
Nov 08 21:46:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d3e78658-c877-4f6d-a729-ff4244480767 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.676s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "ac5baff9-c777-47fe-b799-a075870d897a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "ac5baff9-c777-47fe-b799-a075870d897a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:46:31 user nova-compute[75993]: INFO nova.compute.claims [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Claim successful on node user
Nov 08 21:46:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.107s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:46:31 user nova-compute[75993]: INFO nova.compute.claims [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Claim successful on node user
Nov 08 21:46:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:46:31 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:46:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:46:31 user nova-compute[75993]: DEBUG nova.policy [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f7ce4dd5fa2e4dbfbc817e77249680c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a324eff68a4f3ebbf73ca83664e50b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:46:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Creating image(s)
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "/opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "/opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.209s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.204s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.710s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk 1073741824" returned: 0 in 0.061s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Successfully created port: 504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:46:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.policy [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9276d87f95734c47897fba9ea4fe2d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00def573657242f289160a6a74dd8ad3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:46:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Creating image(s)
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "/opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "/opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "/opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Cannot resize image /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Ensure instance console log exists: /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Successfully updated port: 504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "refresh_cache-ac5baff9-c777-47fe-b799-a075870d897a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquired lock "refresh_cache-ac5baff9-c777-47fe-b799-a075870d897a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-ac9e2426-902c-4cf6-83d7-b8933bff1d5d req-f72a4aeb-dd01-4c4b-8d55-d44843ea1c13 service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Received event network-changed-504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-ac9e2426-902c-4cf6-83d7-b8933bff1d5d req-f72a4aeb-dd01-4c4b-8d55-d44843ea1c13 service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Refreshing instance network info cache due to event network-changed-504c5857-26af-46bc-8c79-cc75f3901877. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ac9e2426-902c-4cf6-83d7-b8933bff1d5d req-f72a4aeb-dd01-4c4b-8d55-d44843ea1c13 service nova] Acquiring lock "refresh_cache-ac5baff9-c777-47fe-b799-a075870d897a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk 1073741824" returned: 0 in 0.053s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.238s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Updating instance_info_cache with network_info: [{"id": "504c5857-26af-46bc-8c79-cc75f3901877", "address": "fa:16:3e:82:f6:91", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504c5857-26", "ovs_interfaceid": "504c5857-26af-46bc-8c79-cc75f3901877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Releasing lock "refresh_cache-ac5baff9-c777-47fe-b799-a075870d897a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Instance network_info: |[{"id": "504c5857-26af-46bc-8c79-cc75f3901877", "address": "fa:16:3e:82:f6:91", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504c5857-26", "ovs_interfaceid": "504c5857-26af-46bc-8c79-cc75f3901877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ac9e2426-902c-4cf6-83d7-b8933bff1d5d req-f72a4aeb-dd01-4c4b-8d55-d44843ea1c13 service nova] Acquired lock "refresh_cache-ac5baff9-c777-47fe-b799-a075870d897a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.network.neutron [req-ac9e2426-902c-4cf6-83d7-b8933bff1d5d req-f72a4aeb-dd01-4c4b-8d55-d44843ea1c13 service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Refreshing network info cache for port 504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Start _get_guest_xml network_info=[{"id": "504c5857-26af-46bc-8c79-cc75f3901877", "address": "fa:16:3e:82:f6:91", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504c5857-26", "ovs_interfaceid": "504c5857-26af-46bc-8c79-cc75f3901877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:46:33 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:33 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:46:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1578367880',display_name='tempest-VolumesActionsTest-instance-1578367880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1578367880',id=26,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a324eff68a4f3ebbf73ca83664e50b',ramdisk_id='',reservation_id='r-0n0aisao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1465914463',owner_user_name='tempest-VolumesActionsTest-1465914463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:46:32Z,user_data=None,user_id='f7ce4dd5fa2e4dbfbc817e77249680c7',uuid=ac5baff9-c777-47fe-b799-a075870d897a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "504c5857-26af-46bc-8c79-cc75f3901877", "address": "fa:16:3e:82:f6:91", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504c5857-26", "ovs_interfaceid": "504c5857-26af-46bc-8c79-cc75f3901877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converting VIF {"id": "504c5857-26af-46bc-8c79-cc75f3901877", "address": "fa:16:3e:82:f6:91", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504c5857-26", "ovs_interfaceid": "504c5857-26af-46bc-8c79-cc75f3901877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:f6:91,bridge_name='br-int',has_traffic_filtering=True,id=504c5857-26af-46bc-8c79-cc75f3901877,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504c5857-26') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.objects.instance [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lazy-loading 'pci_devices' on Instance uuid ac5baff9-c777-47fe-b799-a075870d897a {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:46:33 user nova-compute[75993]:   <uuid>ac5baff9-c777-47fe-b799-a075870d897a</uuid>
Nov 08 21:46:33 user nova-compute[75993]:   <name>instance-0000001a</name>
Nov 08 21:46:33 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:46:33 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:46:33 user nova-compute[75993]:   <metadata>
Nov 08 21:46:33 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:46:33 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:46:33 user nova-compute[75993]:       <nova:name>tempest-VolumesActionsTest-instance-1578367880</nova:name>
Nov 08 21:46:33 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:46:33</nova:creationTime>
Nov 08 21:46:33 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:46:33 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:46:33 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:46:33 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:46:33 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:46:33 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:46:33 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:46:33 user nova-compute[75993]:       <nova:owner>
Nov 08 21:46:33 user nova-compute[75993]:         <nova:user uuid="f7ce4dd5fa2e4dbfbc817e77249680c7">tempest-VolumesActionsTest-1465914463-project-member</nova:user>
Nov 08 21:46:33 user nova-compute[75993]:         <nova:project uuid="93a324eff68a4f3ebbf73ca83664e50b">tempest-VolumesActionsTest-1465914463</nova:project>
Nov 08 21:46:33 user nova-compute[75993]:       </nova:owner>
Nov 08 21:46:33 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:46:33 user nova-compute[75993]:       <nova:ports>
Nov 08 21:46:33 user nova-compute[75993]:         <nova:port uuid="504c5857-26af-46bc-8c79-cc75f3901877">
Nov 08 21:46:33 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 21:46:33 user nova-compute[75993]:         </nova:port>
Nov 08 21:46:33 user nova-compute[75993]:       </nova:ports>
Nov 08 21:46:33 user nova-compute[75993]:     </nova:instance>
Nov 08 21:46:33 user nova-compute[75993]:   </metadata>
Nov 08 21:46:33 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:46:33 user nova-compute[75993]:     <system>
Nov 08 21:46:33 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:46:33 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:46:33 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:46:33 user nova-compute[75993]:       <entry name="serial">ac5baff9-c777-47fe-b799-a075870d897a</entry>
Nov 08 21:46:33 user nova-compute[75993]:       <entry name="uuid">ac5baff9-c777-47fe-b799-a075870d897a</entry>
Nov 08 21:46:33 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:46:33 user nova-compute[75993]:     </system>
Nov 08 21:46:33 user nova-compute[75993]:   </sysinfo>
Nov 08 21:46:33 user nova-compute[75993]:   <os>
Nov 08 21:46:33 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:46:33 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:46:33 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:46:33 user nova-compute[75993]:   </os>
Nov 08 21:46:33 user nova-compute[75993]:   <features>
Nov 08 21:46:33 user nova-compute[75993]:     <acpi/>
Nov 08 21:46:33 user nova-compute[75993]:     <apic/>
Nov 08 21:46:33 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:46:33 user nova-compute[75993]:   </features>
Nov 08 21:46:33 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:46:33 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:46:33 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:46:33 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:46:33 user nova-compute[75993]:   </clock>
Nov 08 21:46:33 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:46:33 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:46:33 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:46:33 user nova-compute[75993]:   </cpu>
Nov 08 21:46:33 user nova-compute[75993]:   <devices>
Nov 08 21:46:33 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:46:33 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:46:33 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk"/>
Nov 08 21:46:33 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:46:33 user nova-compute[75993]:     </disk>
Nov 08 21:46:33 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:46:33 user nova-compute[75993]:       <mac address="fa:16:3e:82:f6:91"/>
Nov 08 21:46:33 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:46:33 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:46:33 user nova-compute[75993]:       <target dev="tap504c5857-26"/>
Nov 08 21:46:33 user nova-compute[75993]:     </interface>
Nov 08 21:46:33 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:46:33 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/console.log" append="off"/>
Nov 08 21:46:33 user nova-compute[75993]:     </serial>
Nov 08 21:46:33 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:46:33 user nova-compute[75993]:     <video>
Nov 08 21:46:33 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:46:33 user nova-compute[75993]:     </video>
Nov 08 21:46:33 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:46:33 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:46:33 user nova-compute[75993]:     </rng>
Nov 08 21:46:33 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:46:33 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:46:33 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:46:33 user nova-compute[75993]:     </memballoon>
Nov 08 21:46:33 user nova-compute[75993]:   </devices>
Nov 08 21:46:33 user nova-compute[75993]: </domain>
Nov 08 21:46:33 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:46:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1578367880',display_name='tempest-VolumesActionsTest-instance-1578367880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1578367880',id=26,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a324eff68a4f3ebbf73ca83664e50b',ramdisk_id='',reservation_id='r-0n0aisao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1465914463',owner_user_name='tempest-VolumesActionsTest-1465914463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:46:32Z,user_data=None,user_id='f7ce4dd5fa2e4dbfbc817e77249680c7',uuid=ac5baff9-c777-47fe-b799-a075870d897a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "504c5857-26af-46bc-8c79-cc75f3901877", "address": "fa:16:3e:82:f6:91", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504c5857-26", "ovs_interfaceid": "504c5857-26af-46bc-8c79-cc75f3901877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converting VIF {"id": "504c5857-26af-46bc-8c79-cc75f3901877", "address": "fa:16:3e:82:f6:91", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504c5857-26", "ovs_interfaceid": "504c5857-26af-46bc-8c79-cc75f3901877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:f6:91,bridge_name='br-int',has_traffic_filtering=True,id=504c5857-26af-46bc-8c79-cc75f3901877,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504c5857-26') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG os_vif [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f6:91,bridge_name='br-int',has_traffic_filtering=True,id=504c5857-26af-46bc-8c79-cc75f3901877,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504c5857-26') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c02dbbd0-5780-5a42-8b0c-551f4e7c66ba', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Cannot resize image /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Ensure instance console log exists: /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap504c5857-26, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap504c5857-26, col_values=(('qos', UUID('f24a7473-deb2-4930-8d8e-32b57db96351')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap504c5857-26, col_values=(('external_ids', {'iface-id': '504c5857-26af-46bc-8c79-cc75f3901877', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:f6:91', 'vm-uuid': 'ac5baff9-c777-47fe-b799-a075870d897a'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:33 user nova-compute[75993]: INFO os_vif [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f6:91,bridge_name='br-int',has_traffic_filtering=True,id=504c5857-26af-46bc-8c79-cc75f3901877,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504c5857-26')
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Successfully created port: 6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:46:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] No VIF found with MAC fa:16:3e:82:f6:91, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-ac9e2426-902c-4cf6-83d7-b8933bff1d5d req-f72a4aeb-dd01-4c4b-8d55-d44843ea1c13 service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Updated VIF entry in instance network info cache for port 504c5857-26af-46bc-8c79-cc75f3901877. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-ac9e2426-902c-4cf6-83d7-b8933bff1d5d req-f72a4aeb-dd01-4c4b-8d55-d44843ea1c13 service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Updating instance_info_cache with network_info: [{"id": "504c5857-26af-46bc-8c79-cc75f3901877", "address": "fa:16:3e:82:f6:91", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504c5857-26", "ovs_interfaceid": "504c5857-26af-46bc-8c79-cc75f3901877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ac9e2426-902c-4cf6-83d7-b8933bff1d5d req-f72a4aeb-dd01-4c4b-8d55-d44843ea1c13 service nova] Releasing lock "refresh_cache-ac5baff9-c777-47fe-b799-a075870d897a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Successfully updated port: 6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "refresh_cache-f047433f-eaaa-4b81-b97c-6aa2f1cecff0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquired lock "refresh_cache-f047433f-eaaa-4b81-b97c-6aa2f1cecff0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-e59e4153-d97c-4af0-9655-d67cfc93f218 req-b0796b9e-4462-44b8-ab6b-8168ae178f59 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-changed-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-e59e4153-d97c-4af0-9655-d67cfc93f218 req-b0796b9e-4462-44b8-ab6b-8168ae178f59 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Refreshing instance network info cache due to event network-changed-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e59e4153-d97c-4af0-9655-d67cfc93f218 req-b0796b9e-4462-44b8-ab6b-8168ae178f59 service nova] Acquiring lock "refresh_cache-f047433f-eaaa-4b81-b97c-6aa2f1cecff0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Updating instance_info_cache with network_info: [{"id": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "address": "fa:16:3e:b1:ee:3f", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc7f32b-90", "ovs_interfaceid": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Releasing lock "refresh_cache-f047433f-eaaa-4b81-b97c-6aa2f1cecff0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Instance network_info: |[{"id": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "address": "fa:16:3e:b1:ee:3f", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc7f32b-90", "ovs_interfaceid": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e59e4153-d97c-4af0-9655-d67cfc93f218 req-b0796b9e-4462-44b8-ab6b-8168ae178f59 service nova] Acquired lock "refresh_cache-f047433f-eaaa-4b81-b97c-6aa2f1cecff0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-e59e4153-d97c-4af0-9655-d67cfc93f218 req-b0796b9e-4462-44b8-ab6b-8168ae178f59 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Refreshing network info cache for port 6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Start _get_guest_xml network_info=[{"id": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "address": "fa:16:3e:b1:ee:3f", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc7f32b-90", "ovs_interfaceid": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:46:34 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:34 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1192898756',display_name='tempest-AttachVolumeTestJSON-server-1192898756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1192898756',id=27,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCavfzPdyZR0hC9Dtk00SIVzO7wofuBGow/+mTLml1kA8wrk1QDXNFyc0KzGE5gse5ERSayXaNRDQRkCNOo18zZ/TG7chvHeIQQmXYYm0fNhLV12ZkrQJMUDZ1BOGH9B8A==',key_name='tempest-keypair-948748209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-n5af4wwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:46:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=f047433f-eaaa-4b81-b97c-6aa2f1cecff0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "address": "fa:16:3e:b1:ee:3f", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc7f32b-90", "ovs_interfaceid": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "address": "fa:16:3e:b1:ee:3f", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc7f32b-90", "ovs_interfaceid": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cc7f32b-9074-4af0-a9c8-6a8a85fe166b,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc7f32b-90') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.objects.instance [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'pci_devices' on Instance uuid f047433f-eaaa-4b81-b97c-6aa2f1cecff0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:46:34 user nova-compute[75993]:   <uuid>f047433f-eaaa-4b81-b97c-6aa2f1cecff0</uuid>
Nov 08 21:46:34 user nova-compute[75993]:   <name>instance-0000001b</name>
Nov 08 21:46:34 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:46:34 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:46:34 user nova-compute[75993]:   <metadata>
Nov 08 21:46:34 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:46:34 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:46:34 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeTestJSON-server-1192898756</nova:name>
Nov 08 21:46:34 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:46:34</nova:creationTime>
Nov 08 21:46:34 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:46:34 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:46:34 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:46:34 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:46:34 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:46:34 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:46:34 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:46:34 user nova-compute[75993]:       <nova:owner>
Nov 08 21:46:34 user nova-compute[75993]:         <nova:user uuid="9276d87f95734c47897fba9ea4fe2d94">tempest-AttachVolumeTestJSON-1483084463-project-member</nova:user>
Nov 08 21:46:34 user nova-compute[75993]:         <nova:project uuid="00def573657242f289160a6a74dd8ad3">tempest-AttachVolumeTestJSON-1483084463</nova:project>
Nov 08 21:46:34 user nova-compute[75993]:       </nova:owner>
Nov 08 21:46:34 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:46:34 user nova-compute[75993]:       <nova:ports>
Nov 08 21:46:34 user nova-compute[75993]:         <nova:port uuid="6cc7f32b-9074-4af0-a9c8-6a8a85fe166b">
Nov 08 21:46:34 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 21:46:34 user nova-compute[75993]:         </nova:port>
Nov 08 21:46:34 user nova-compute[75993]:       </nova:ports>
Nov 08 21:46:34 user nova-compute[75993]:     </nova:instance>
Nov 08 21:46:34 user nova-compute[75993]:   </metadata>
Nov 08 21:46:34 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:46:34 user nova-compute[75993]:     <system>
Nov 08 21:46:34 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:46:34 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:46:34 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:46:34 user nova-compute[75993]:       <entry name="serial">f047433f-eaaa-4b81-b97c-6aa2f1cecff0</entry>
Nov 08 21:46:34 user nova-compute[75993]:       <entry name="uuid">f047433f-eaaa-4b81-b97c-6aa2f1cecff0</entry>
Nov 08 21:46:34 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:46:34 user nova-compute[75993]:     </system>
Nov 08 21:46:34 user nova-compute[75993]:   </sysinfo>
Nov 08 21:46:34 user nova-compute[75993]:   <os>
Nov 08 21:46:34 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:46:34 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:46:34 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:46:34 user nova-compute[75993]:   </os>
Nov 08 21:46:34 user nova-compute[75993]:   <features>
Nov 08 21:46:34 user nova-compute[75993]:     <acpi/>
Nov 08 21:46:34 user nova-compute[75993]:     <apic/>
Nov 08 21:46:34 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:46:34 user nova-compute[75993]:   </features>
Nov 08 21:46:34 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:46:34 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:46:34 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:46:34 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:46:34 user nova-compute[75993]:   </clock>
Nov 08 21:46:34 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:46:34 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:46:34 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:46:34 user nova-compute[75993]:   </cpu>
Nov 08 21:46:34 user nova-compute[75993]:   <devices>
Nov 08 21:46:34 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:46:34 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:46:34 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk"/>
Nov 08 21:46:34 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:46:34 user nova-compute[75993]:     </disk>
Nov 08 21:46:34 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:46:34 user nova-compute[75993]:       <mac address="fa:16:3e:b1:ee:3f"/>
Nov 08 21:46:34 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:46:34 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:46:34 user nova-compute[75993]:       <target dev="tap6cc7f32b-90"/>
Nov 08 21:46:34 user nova-compute[75993]:     </interface>
Nov 08 21:46:34 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:46:34 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/console.log" append="off"/>
Nov 08 21:46:34 user nova-compute[75993]:     </serial>
Nov 08 21:46:34 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:46:34 user nova-compute[75993]:     <video>
Nov 08 21:46:34 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:46:34 user nova-compute[75993]:     </video>
Nov 08 21:46:34 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:46:34 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:46:34 user nova-compute[75993]:     </rng>
Nov 08 21:46:34 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:46:34 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:46:34 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:46:34 user nova-compute[75993]:     </memballoon>
Nov 08 21:46:34 user nova-compute[75993]:   </devices>
Nov 08 21:46:34 user nova-compute[75993]: </domain>
Nov 08 21:46:34 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1192898756',display_name='tempest-AttachVolumeTestJSON-server-1192898756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1192898756',id=27,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCavfzPdyZR0hC9Dtk00SIVzO7wofuBGow/+mTLml1kA8wrk1QDXNFyc0KzGE5gse5ERSayXaNRDQRkCNOo18zZ/TG7chvHeIQQmXYYm0fNhLV12ZkrQJMUDZ1BOGH9B8A==',key_name='tempest-keypair-948748209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-n5af4wwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:46:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=f047433f-eaaa-4b81-b97c-6aa2f1cecff0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "address": "fa:16:3e:b1:ee:3f", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc7f32b-90", "ovs_interfaceid": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "address": "fa:16:3e:b1:ee:3f", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc7f32b-90", "ovs_interfaceid": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cc7f32b-9074-4af0-a9c8-6a8a85fe166b,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc7f32b-90') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG os_vif [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cc7f32b-9074-4af0-a9c8-6a8a85fe166b,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc7f32b-90') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bd950e5-12d7-5808-a07d-49f5b2c3e197', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cc7f32b-90, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cc7f32b-90, col_values=(('qos', UUID('0b783a3a-36b1-4171-941f-1766d979c657')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cc7f32b-90, col_values=(('external_ids', {'iface-id': '6cc7f32b-9074-4af0-a9c8-6a8a85fe166b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:ee:3f', 'vm-uuid': 'f047433f-eaaa-4b81-b97c-6aa2f1cecff0'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:34 user nova-compute[75993]: INFO os_vif [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:ee:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cc7f32b-9074-4af0-a9c8-6a8a85fe166b,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc7f32b-90')
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:46:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] No VIF found with MAC fa:16:3e:b1:ee:3f, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG nova.network.neutron [req-e59e4153-d97c-4af0-9655-d67cfc93f218 req-b0796b9e-4462-44b8-ab6b-8168ae178f59 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Updated VIF entry in instance network info cache for port 6cc7f32b-9074-4af0-a9c8-6a8a85fe166b. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG nova.network.neutron [req-e59e4153-d97c-4af0-9655-d67cfc93f218 req-b0796b9e-4462-44b8-ab6b-8168ae178f59 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Updating instance_info_cache with network_info: [{"id": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "address": "fa:16:3e:b1:ee:3f", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc7f32b-90", "ovs_interfaceid": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e59e4153-d97c-4af0-9655-d67cfc93f218 req-b0796b9e-4462-44b8-ab6b-8168ae178f59 service nova] Releasing lock "refresh_cache-f047433f-eaaa-4b81-b97c-6aa2f1cecff0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-3065f815-1d4c-4edf-8431-43cebeb3fb39 req-bc5f7cf1-f019-4092-9006-d5747f6c4318 service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Received event network-vif-plugged-504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3065f815-1d4c-4edf-8431-43cebeb3fb39 req-bc5f7cf1-f019-4092-9006-d5747f6c4318 service nova] Acquiring lock "ac5baff9-c777-47fe-b799-a075870d897a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3065f815-1d4c-4edf-8431-43cebeb3fb39 req-bc5f7cf1-f019-4092-9006-d5747f6c4318 service nova] Lock "ac5baff9-c777-47fe-b799-a075870d897a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3065f815-1d4c-4edf-8431-43cebeb3fb39 req-bc5f7cf1-f019-4092-9006-d5747f6c4318 service nova] Lock "ac5baff9-c777-47fe-b799-a075870d897a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-3065f815-1d4c-4edf-8431-43cebeb3fb39 req-bc5f7cf1-f019-4092-9006-d5747f6c4318 service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] No waiting events found dispatching network-vif-plugged-504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:46:35 user nova-compute[75993]: WARNING nova.compute.manager [req-3065f815-1d4c-4edf-8431-43cebeb3fb39 req-bc5f7cf1-f019-4092-9006-d5747f6c4318 service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Received unexpected event network-vif-plugged-504c5857-26af-46bc-8c79-cc75f3901877 for instance with vm_state building and task_state spawning.
Nov 08 21:46:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:36 user nova-compute[75993]: DEBUG nova.objects.instance [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'flavor' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:46:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-8bee2377-3e8d-451f-beab-58cc97ec2405 req-9a04dc83-b2d8-4e9a-ab26-8bd86e652da1 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8bee2377-3e8d-451f-beab-58cc97ec2405 req-9a04dc83-b2d8-4e9a-ab26-8bd86e652da1 service nova] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8bee2377-3e8d-451f-beab-58cc97ec2405 req-9a04dc83-b2d8-4e9a-ab26-8bd86e652da1 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8bee2377-3e8d-451f-beab-58cc97ec2405 req-9a04dc83-b2d8-4e9a-ab26-8bd86e652da1 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-8bee2377-3e8d-451f-beab-58cc97ec2405 req-9a04dc83-b2d8-4e9a-ab26-8bd86e652da1 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] No waiting events found dispatching network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:46:37 user nova-compute[75993]: WARNING nova.compute.manager [req-8bee2377-3e8d-451f-beab-58cc97ec2405 req-9a04dc83-b2d8-4e9a-ab26-8bd86e652da1 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received unexpected event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b for instance with vm_state building and task_state spawning.
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:37 user nova-compute[75993]: INFO nova.compute.manager [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Attaching volume db1c38e9-2000-4a04-8b9c-50c7207f6dde to /dev/vdb
Nov 08 21:46:37 user nova-compute[75993]: DEBUG os_brick.utils [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1020ca0-4677-43db-9a1e-a22e0f9735ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c085232c-cb0b-4a4a-81d5-25ef835f80ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a180405-745b-46ef-8987-fa4befc30216]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f745a5-1c3a-4a35-8276-15e4d6033512]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:46:37 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f04acc9-2756-4217-8395-281abe02c961]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG os_brick.utils [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updating existing volume attachment record: 2cda8598-eada-4fbe-9474-807f18b4753f {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-3066ec71-a40f-4daf-8af0-8233248d4557 req-c65d4c98-08d9-4267-b16b-5b7dc00a94a9 service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Received event network-vif-plugged-504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3066ec71-a40f-4daf-8af0-8233248d4557 req-c65d4c98-08d9-4267-b16b-5b7dc00a94a9 service nova] Acquiring lock "ac5baff9-c777-47fe-b799-a075870d897a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3066ec71-a40f-4daf-8af0-8233248d4557 req-c65d4c98-08d9-4267-b16b-5b7dc00a94a9 service nova] Lock "ac5baff9-c777-47fe-b799-a075870d897a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3066ec71-a40f-4daf-8af0-8233248d4557 req-c65d4c98-08d9-4267-b16b-5b7dc00a94a9 service nova] Lock "ac5baff9-c777-47fe-b799-a075870d897a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-3066ec71-a40f-4daf-8af0-8233248d4557 req-c65d4c98-08d9-4267-b16b-5b7dc00a94a9 service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] No waiting events found dispatching network-vif-plugged-504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:46:37 user nova-compute[75993]: WARNING nova.compute.manager [req-3066ec71-a40f-4daf-8af0-8233248d4557 req-c65d4c98-08d9-4267-b16b-5b7dc00a94a9 service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Received unexpected event network-vif-plugged-504c5857-26af-46bc-8c79-cc75f3901877 for instance with vm_state building and task_state spawning.
Nov 08 21:46:38 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:46:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:46:38 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Instance spawned successfully.
Nov 08 21:46:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:46:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:38 user nova-compute[75993]: INFO nova.compute.manager [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Took 6.89 seconds to spawn the instance on the hypervisor.
Nov 08 21:46:38 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:46:38 user nova-compute[75993]: INFO nova.compute.manager [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Took 7.75 seconds to build instance.
Nov 08 21:46:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c1235560-4237-4780-97a9-b2d9c364bae8 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "ac5baff9-c777-47fe-b799-a075870d897a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.887s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-141aa6f6-2a56-4f83-a3d9-665436d20caa req-3ea4b27b-815f-4045-890b-a996086bdffb service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-141aa6f6-2a56-4f83-a3d9-665436d20caa req-3ea4b27b-815f-4045-890b-a996086bdffb service nova] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-141aa6f6-2a56-4f83-a3d9-665436d20caa req-3ea4b27b-815f-4045-890b-a996086bdffb service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-141aa6f6-2a56-4f83-a3d9-665436d20caa req-3ea4b27b-815f-4045-890b-a996086bdffb service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-141aa6f6-2a56-4f83-a3d9-665436d20caa req-3ea4b27b-815f-4045-890b-a996086bdffb service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] No waiting events found dispatching network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:46:39 user nova-compute[75993]: WARNING nova.compute.manager [req-141aa6f6-2a56-4f83-a3d9-665436d20caa req-3ea4b27b-815f-4045-890b-a996086bdffb service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received unexpected event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b for instance with vm_state building and task_state spawning.
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:46:39 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Instance spawned successfully.
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:39 user nova-compute[75993]: INFO nova.compute.manager [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Took 6.44 seconds to spawn the instance on the hypervisor.
Nov 08 21:46:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:46:39 user nova-compute[75993]: INFO nova.compute.manager [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Took 7.77 seconds to build instance.
Nov 08 21:46:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5a0b91d8-5900-4aa4-9ccf-a27eaba49245 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.870s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:46:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:46:41 user nova-compute[75993]: INFO nova.compute.claims [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Claim successful on node user
Nov 08 21:46:41 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:46:41 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:46:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.722s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:46:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:46:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:46:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:46:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG nova.policy [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24c7a7bdeeda41339b11c9e9e1ad4c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fc6c404c244ccba1a90b11e5437de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:46:42 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Creating image(s)
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "/opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "/opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.220s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.214s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk 1073741824" returned: 0 in 0.067s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Successfully created port: 89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.214s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:46:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Cannot resize image /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Ensure instance console log exists: /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Successfully updated port: 89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquired lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-e4347694-2c6e-44bb-8720-f52239642bcf req-f9076bec-8d83-4535-bc18-e64d805b5366 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-changed-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-e4347694-2c6e-44bb-8720-f52239642bcf req-f9076bec-8d83-4535-bc18-e64d805b5366 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Refreshing instance network info cache due to event network-changed-89871e15-aec8-4d15-8672-313d84c98870. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e4347694-2c6e-44bb-8720-f52239642bcf req-f9076bec-8d83-4535-bc18-e64d805b5366 service nova] Acquiring lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Updating instance_info_cache with network_info: [{"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Releasing lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:46:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Instance network_info: |[{"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e4347694-2c6e-44bb-8720-f52239642bcf req-f9076bec-8d83-4535-bc18-e64d805b5366 service nova] Acquired lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-e4347694-2c6e-44bb-8720-f52239642bcf req-f9076bec-8d83-4535-bc18-e64d805b5366 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Refreshing network info cache for port 89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Start _get_guest_xml network_info=[{"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:46:44 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:44 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1222137561',display_name='tempest-tempest.common.compute-instance-1222137561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1222137561',id=28,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx16iEb6CeFHI0TasVxtYtLjeV3PPjbyaq7k//aB1Zq4ApiAjvF8kHWO6ru0wGEM9NttEZOQsBaV9WtV6vPGjv/2ZDyxWsE6IzcbI1GOMvT4gB4T5MAXhahrl24BHfVYQ==',key_name='tempest-keypair-1858342574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-laco4f50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.objects.instance [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'pci_devices' on Instance uuid f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:46:44 user nova-compute[75993]:   <uuid>f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f</uuid>
Nov 08 21:46:44 user nova-compute[75993]:   <name>instance-0000001c</name>
Nov 08 21:46:44 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:46:44 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:46:44 user nova-compute[75993]:   <metadata>
Nov 08 21:46:44 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:46:44 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:46:44 user nova-compute[75993]:       <nova:name>tempest-tempest.common.compute-instance-1222137561</nova:name>
Nov 08 21:46:44 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:46:44</nova:creationTime>
Nov 08 21:46:44 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:46:44 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:46:44 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:46:44 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:46:44 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:46:44 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:46:44 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:46:44 user nova-compute[75993]:       <nova:owner>
Nov 08 21:46:44 user nova-compute[75993]:         <nova:user uuid="24c7a7bdeeda41339b11c9e9e1ad4c8d">tempest-ServerActionsTestOtherA-1530278199-project-member</nova:user>
Nov 08 21:46:44 user nova-compute[75993]:         <nova:project uuid="696fc6c404c244ccba1a90b11e5437de">tempest-ServerActionsTestOtherA-1530278199</nova:project>
Nov 08 21:46:44 user nova-compute[75993]:       </nova:owner>
Nov 08 21:46:44 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:46:44 user nova-compute[75993]:       <nova:ports>
Nov 08 21:46:44 user nova-compute[75993]:         <nova:port uuid="89871e15-aec8-4d15-8672-313d84c98870">
Nov 08 21:46:44 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 21:46:44 user nova-compute[75993]:         </nova:port>
Nov 08 21:46:44 user nova-compute[75993]:       </nova:ports>
Nov 08 21:46:44 user nova-compute[75993]:     </nova:instance>
Nov 08 21:46:44 user nova-compute[75993]:   </metadata>
Nov 08 21:46:44 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:46:44 user nova-compute[75993]:     <system>
Nov 08 21:46:44 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:46:44 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:46:44 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:46:44 user nova-compute[75993]:       <entry name="serial">f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f</entry>
Nov 08 21:46:44 user nova-compute[75993]:       <entry name="uuid">f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f</entry>
Nov 08 21:46:44 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:46:44 user nova-compute[75993]:     </system>
Nov 08 21:46:44 user nova-compute[75993]:   </sysinfo>
Nov 08 21:46:44 user nova-compute[75993]:   <os>
Nov 08 21:46:44 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:46:44 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:46:44 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:46:44 user nova-compute[75993]:   </os>
Nov 08 21:46:44 user nova-compute[75993]:   <features>
Nov 08 21:46:44 user nova-compute[75993]:     <acpi/>
Nov 08 21:46:44 user nova-compute[75993]:     <apic/>
Nov 08 21:46:44 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:46:44 user nova-compute[75993]:   </features>
Nov 08 21:46:44 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:46:44 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:46:44 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:46:44 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:46:44 user nova-compute[75993]:   </clock>
Nov 08 21:46:44 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:46:44 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:46:44 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:46:44 user nova-compute[75993]:   </cpu>
Nov 08 21:46:44 user nova-compute[75993]:   <devices>
Nov 08 21:46:44 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:46:44 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:46:44 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk"/>
Nov 08 21:46:44 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:46:44 user nova-compute[75993]:     </disk>
Nov 08 21:46:44 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:46:44 user nova-compute[75993]:       <mac address="fa:16:3e:16:21:b5"/>
Nov 08 21:46:44 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:46:44 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:46:44 user nova-compute[75993]:       <target dev="tap89871e15-ae"/>
Nov 08 21:46:44 user nova-compute[75993]:     </interface>
Nov 08 21:46:44 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:46:44 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/console.log" append="off"/>
Nov 08 21:46:44 user nova-compute[75993]:     </serial>
Nov 08 21:46:44 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:46:44 user nova-compute[75993]:     <video>
Nov 08 21:46:44 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:46:44 user nova-compute[75993]:     </video>
Nov 08 21:46:44 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:46:44 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:46:44 user nova-compute[75993]:     </rng>
Nov 08 21:46:44 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:46:44 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:46:44 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:46:44 user nova-compute[75993]:     </memballoon>
Nov 08 21:46:44 user nova-compute[75993]:   </devices>
Nov 08 21:46:44 user nova-compute[75993]: </domain>
Nov 08 21:46:44 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1222137561',display_name='tempest-tempest.common.compute-instance-1222137561',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1222137561',id=28,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx16iEb6CeFHI0TasVxtYtLjeV3PPjbyaq7k//aB1Zq4ApiAjvF8kHWO6ru0wGEM9NttEZOQsBaV9WtV6vPGjv/2ZDyxWsE6IzcbI1GOMvT4gB4T5MAXhahrl24BHfVYQ==',key_name='tempest-keypair-1858342574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-laco4f50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG os_vif [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '409ceab2-5c0b-5b1e-94aa-d9a485614d81', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89871e15-ae, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89871e15-ae, col_values=(('qos', UUID('b9799cf9-77bc-43cc-8847-0fc7a79245c7')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89871e15-ae, col_values=(('external_ids', {'iface-id': '89871e15-aec8-4d15-8672-313d84c98870', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:21:b5', 'vm-uuid': 'f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:44 user nova-compute[75993]: INFO os_vif [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae')
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No VIF found with MAC fa:16:3e:16:21:b5, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-e4347694-2c6e-44bb-8720-f52239642bcf req-f9076bec-8d83-4535-bc18-e64d805b5366 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Updated VIF entry in instance network info cache for port 89871e15-aec8-4d15-8672-313d84c98870. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-e4347694-2c6e-44bb-8720-f52239642bcf req-f9076bec-8d83-4535-bc18-e64d805b5366 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Updating instance_info_cache with network_info: [{"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:46:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e4347694-2c6e-44bb-8720-f52239642bcf req-f9076bec-8d83-4535-bc18-e64d805b5366 service nova] Releasing lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:46:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-67577074-9c54-489e-be41-b805cce3a9b3 req-1645682a-7a17-428f-881e-ce0e77d3e298 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-67577074-9c54-489e-be41-b805cce3a9b3 req-1645682a-7a17-428f-881e-ce0e77d3e298 service nova] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-67577074-9c54-489e-be41-b805cce3a9b3 req-1645682a-7a17-428f-881e-ce0e77d3e298 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-67577074-9c54-489e-be41-b805cce3a9b3 req-1645682a-7a17-428f-881e-ce0e77d3e298 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-67577074-9c54-489e-be41-b805cce3a9b3 req-1645682a-7a17-428f-881e-ce0e77d3e298 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] No waiting events found dispatching network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:46:46 user nova-compute[75993]: WARNING nova.compute.manager [req-67577074-9c54-489e-be41-b805cce3a9b3 req-1645682a-7a17-428f-881e-ce0e77d3e298 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received unexpected event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 for instance with vm_state building and task_state spawning.
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:46:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Instance spawned successfully.
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:46:48 user nova-compute[75993]: INFO nova.compute.manager [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Took 6.31 seconds to spawn the instance on the hypervisor.
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-3f07cc04-d12f-428e-95fd-02e108ac11e3 req-9306c287-0186-48ea-91db-b00a5ddc8eb3 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3f07cc04-d12f-428e-95fd-02e108ac11e3 req-9306c287-0186-48ea-91db-b00a5ddc8eb3 service nova] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3f07cc04-d12f-428e-95fd-02e108ac11e3 req-9306c287-0186-48ea-91db-b00a5ddc8eb3 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3f07cc04-d12f-428e-95fd-02e108ac11e3 req-9306c287-0186-48ea-91db-b00a5ddc8eb3 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-3f07cc04-d12f-428e-95fd-02e108ac11e3 req-9306c287-0186-48ea-91db-b00a5ddc8eb3 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] No waiting events found dispatching network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:46:48 user nova-compute[75993]: WARNING nova.compute.manager [req-3f07cc04-d12f-428e-95fd-02e108ac11e3 req-9306c287-0186-48ea-91db-b00a5ddc8eb3 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received unexpected event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 for instance with vm_state building and task_state spawning.
Nov 08 21:46:48 user nova-compute[75993]: INFO nova.compute.manager [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Took 7.47 seconds to build instance.
Nov 08 21:46:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6137a465-9f2b-4937-a924-3a9a65500fe9 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.604s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:46:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:57 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:46:57 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:46:57 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 21:46:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:46:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:46:57 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:46:57 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updating instance_info_cache with network_info: [{"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-adef30df-4254-4133-9db2-4c7708cd1996" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:46:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:47:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.229s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHAZMJuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:47:03 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:03 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:03 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:03 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:03 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:03 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:47:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260" returned: 21 in 0.045s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7aea9ab-16d6-4aaa-9c0b-763ab182ad25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:47:04 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7fa21e-9a5e-4c04-b56b-84666f8d3d56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde] added
Nov 08 21:47:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[359e3bea-be1b-40bb-be8c-8e7a8a072ca0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a1d744-76a8-4bae-a6d5-71357b664fa7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHAZMJuG {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHAZMJuG" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[df771f2a-c4d0-444a-85c7-90edbd10cd17]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHAZMJuG'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9b20ce-7dc0-4210-81af-6d202b5dbf44]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ca4d73-c5fe-4ec5-8871-d80b0e4b5b30]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc8685f-3d6c-4eb6-89fa-6cfbafe88910]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde, portal: 172.16.0.220,3260]
Nov 08 21:47:04 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde, portal: 172.16.0.220,3260] successful.
Nov 08 21:47:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:47:04 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7045MB free_disk=25.09062957763672GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:04 user nova-compute[75993]: INFO nova.compute.manager [None req-8ef0044b-f982-47c3-a417-62998527d67e tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Unrescuing
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8ef0044b-f982-47c3-a417-62998527d67e tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8ef0044b-f982-47c3-a417-62998527d67e tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquired lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8ef0044b-f982-47c3-a417-62998527d67e tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb934be-92ec-414a-aec1-d3cda0d78476]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b63143-dc3a-43e1-a598-edec574c0db8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:04 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.758s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f525df4-65db-4de9-ae19-52feed2b2b04]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHAZMJuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Applying migration context for instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 as it has an incoming, in-progress migration 7b299dd2-f2e1-4642-a3a8-a15f0ed5130b. Migration status is finished {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 21:47:04 user nova-compute[75993]: INFO nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating resource usage from migration 7b299dd2-f2e1-4642-a3a8-a15f0ed5130b
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance cd48056d-13f0-4d8e-839e-0bd392c60478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Migration 7b299dd2-f2e1-4642-a3a8-a15f0ed5130b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance a3c86d97-9bc3-45a0-98da-9dbc56890b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance ac5baff9-c777-47fe-b799-a075870d897a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f047433f-eaaa-4b81-b97c-6aa2f1cecff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:47:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8ef0044b-f982-47c3-a417-62998527d67e tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updating instance_info_cache with network_info: [{"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8ef0044b-f982-47c3-a417-62998527d67e tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Releasing lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG nova.objects.instance [None req-8ef0044b-f982-47c3-a417-62998527d67e tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'flavor' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-0ed67324-cdf1-438a-ba44-fa0b5c7621b0 req-e3fdc3ad-5cbe-4520-b19b-4d7d984e3492 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-unplugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0ed67324-cdf1-438a-ba44-fa0b5c7621b0 req-e3fdc3ad-5cbe-4520-b19b-4d7d984e3492 service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0ed67324-cdf1-438a-ba44-fa0b5c7621b0 req-e3fdc3ad-5cbe-4520-b19b-4d7d984e3492 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0ed67324-cdf1-438a-ba44-fa0b5c7621b0 req-e3fdc3ad-5cbe-4520-b19b-4d7d984e3492 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-0ed67324-cdf1-438a-ba44-fa0b5c7621b0 req-e3fdc3ad-5cbe-4520-b19b-4d7d984e3492 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-unplugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:05 user nova-compute[75993]: WARNING nova.compute.manager [req-0ed67324-cdf1-438a-ba44-fa0b5c7621b0 req-e3fdc3ad-5cbe-4520-b19b-4d7d984e3492 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received unexpected event network-vif-unplugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:47:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.798s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] <== connect_volume: return (1800ms) {'type': 'block', 'scsi_wwn': '23633626535383739', 'path': '/dev/sde'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633626535383739', 'path': '/dev/sde'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG nova.objects.instance [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'flavor' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:47:05 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:47:05 user nova-compute[75993]:   <source dev="/dev/sde"/>
Nov 08 21:47:05 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:47:05 user nova-compute[75993]:   <serial>db1c38e9-2000-4a04-8b9c-50c7207f6dde</serial>
Nov 08 21:47:05 user nova-compute[75993]: </disk>
Nov 08 21:47:05 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:47:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Instance destroyed successfully.
Nov 08 21:47:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:47:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:47:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] No VIF found with MAC fa:16:3e:f2:0f:71, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:47:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6563f3eb-3c31-4daf-a439-d1504b829ce8 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.733s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-3dbb510e-c61e-476d-beab-0f610bb22b9d req-8f9b3ca2-b1eb-4a84-919d-2d662a3d9b34 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3dbb510e-c61e-476d-beab-0f610bb22b9d req-8f9b3ca2-b1eb-4a84-919d-2d662a3d9b34 service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3dbb510e-c61e-476d-beab-0f610bb22b9d req-8f9b3ca2-b1eb-4a84-919d-2d662a3d9b34 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3dbb510e-c61e-476d-beab-0f610bb22b9d req-8f9b3ca2-b1eb-4a84-919d-2d662a3d9b34 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-3dbb510e-c61e-476d-beab-0f610bb22b9d req-8f9b3ca2-b1eb-4a84-919d-2d662a3d9b34 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:07 user nova-compute[75993]: WARNING nova.compute.manager [req-3dbb510e-c61e-476d-beab-0f610bb22b9d req-8f9b3ca2-b1eb-4a84-919d-2d662a3d9b34 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received unexpected event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:47:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:08 user nova-compute[75993]: INFO nova.compute.manager [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Rescuing
Nov 08 21:47:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:47:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquired lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:47:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:47:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updating instance_info_cache with network_info: [{"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:47:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Releasing lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:47:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:09 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Instance destroyed successfully.
Nov 08 21:47:09 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Attempting a stable device rescue
Nov 08 21:47:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75993) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Instance directory exists: not creating {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 21:47:09 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Creating image(s)
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "/opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "/opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG nova.objects.instance [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:09 user nova-compute[75993]: WARNING nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received unexpected event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:47:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:09 user nova-compute[75993]: WARNING nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received unexpected event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:47:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-unplugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-unplugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:09 user nova-compute[75993]: WARNING nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received unexpected event network-vif-unplugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with vm_state active and task_state rescuing.
Nov 08 21:47:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:09 user nova-compute[75993]: WARNING nova.compute.manager [req-fb06899f-51d7-46f9-8571-acc1eb61e3b3 req-6dedca92-8072-4512-ab1f-75c553fb4bef service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received unexpected event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with vm_state active and task_state rescuing.
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "f47e3dd579f74797b99d032927f3e4c796e47a4f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "f47e3dd579f74797b99d032927f3e4c796e47a4f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f.part --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8ef0044b-f982-47c3-a417-62998527d67e tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:47:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f.part --force-share --output=json" returned: 0 in 0.191s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:10 user nova-compute[75993]: DEBUG nova.virt.images [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] 8f7c71b7-97de-4a2e-a682-7af8f4383b3c was qcow2, converting to raw {{(pid=75993) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 21:47:10 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:47:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f.part /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f.converted {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f.part /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f.converted" returned: 0 in 0.438s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f.converted --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "f47e3dd579f74797b99d032927f3e4c796e47a4f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.829s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "f47e3dd579f74797b99d032927f3e4c796e47a4f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "f47e3dd579f74797b99d032927f3e4c796e47a4f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f --force-share --output=json" returned: 0 in 0.223s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f,backing_fmt=raw /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.rescue {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f,backing_fmt=raw /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.rescue" returned: 0 in 0.054s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "f47e3dd579f74797b99d032927f3e4c796e47a4f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.objects.instance [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'migration_context' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.objects.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Object Instance<7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Start _get_guest_xml network_info=[{"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "vif_mac": "fa:16:3e:f2:0f:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8f7c71b7-97de-4a2e-a682-7af8f4383b3c', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '2cda8598-eada-4fbe-9474-807f18b4753f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHAZMJuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'db1c38e9-2000-4a04-8b9c-50c7207f6dde', 'serial': 'db1c38e9-2000-4a04-8b9c-50c7207f6dde'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.objects.instance [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'resources' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.objects.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Object Instance<7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.objects.instance [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'numa_topology' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.objects.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Object Instance<7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:47:11 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:47:11 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.objects.instance [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.objects.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Object Instance<7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHAZMJuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:47:11 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:11 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:11 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5474641b-b3e5-40be-b9f2-da8b0c203b18]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = iHAZMJuG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 21:47:11 user nova-compute[75993]: node.name = iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde
Nov 08 21:47:11 user nova-compute[75993]: node.tpgt = -1
Nov 08 21:47:11 user nova-compute[75993]: node.startup = automatic
Nov 08 21:47:11 user nova-compute[75993]: node.leading_login = No
Nov 08 21:47:11 user nova-compute[75993]: iface.iscsi_ifacename = default
Nov 08 21:47:11 user nova-compute[75993]: iface.net_ifacename = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.ipaddress = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.prefix_len = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.hwaddress = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.transport_name = tcp
Nov 08 21:47:11 user nova-compute[75993]: iface.initiatorname = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.state = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.vlan_id = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.vlan_priority = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.vlan_state = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.iface_num = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.mtu = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.port = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.bootproto = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.subnet_mask = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.gateway = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.dhcp_alt_client_id = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.dhcp_dns = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.dhcp_learn_iqn = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.dhcp_vendor_id_state = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.dhcp_vendor_id = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.dhcp_slp_da = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.fragmentation = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.gratuitous_arp = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.incoming_forwarding = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.tos_state = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.tos = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.ttl = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.delayed_ack = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.tcp_nagle = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.tcp_wsf_state = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.tcp_wsf = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.tcp_timer_scale = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.tcp_timestamp = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.redirect = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.def_task_mgmt_timeout = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.header_digest = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.data_digest = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.immediate_data = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.initial_r2t = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.data_seq_inorder = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.data_pdu_inorder = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.erl = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.max_receive_data_len = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.first_burst_len = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.max_outstanding_r2t = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.max_burst_len = 0
Nov 08 21:47:11 user nova-compute[75993]: iface.chap_auth = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.bidi_chap = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.strict_login_compliance = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.discovery_auth = <empty>
Nov 08 21:47:11 user nova-compute[75993]: iface.discovery_logout = <empty>
Nov 08 21:47:11 user nova-compute[75993]: node.discovery_address = <empty>
Nov 08 21:47:11 user nova-compute[75993]: node.discovery_port = 0
Nov 08 21:47:11 user nova-compute[75993]: node.discovery_type = static
Nov 08 21:47:11 user nova-compute[75993]: node.session.initial_cmdsn = 0
Nov 08 21:47:11 user nova-compute[75993]: node.session.initial_login_retry_max = 8
Nov 08 21:47:11 user nova-compute[75993]: node.session.xmit_thread_priority = -20
Nov 08 21:47:11 user nova-compute[75993]: node.session.cmds_max = 128
Nov 08 21:47:11 user nova-compute[75993]: node.session.queue_depth = 32
Nov 08 21:47:11 user nova-compute[75993]: node.session.nr_sessions = 1
Nov 08 21:47:11 user nova-compute[75993]: node.session.auth.authmethod = CHAP
Nov 08 21:47:11 user nova-compute[75993]: node.session.auth.username = iHAZMJuG
Nov 08 21:47:11 user nova-compute[75993]: node.session.auth.password = ***
Nov 08 21:47:11 user nova-compute[75993]: node.session.auth.username_in = <empty>
Nov 08 21:47:11 user nova-compute[75993]: node.session.auth.password_in = <empty>
Nov 08 21:47:11 user nova-compute[75993]: node.session.auth.chap_algs = MD5
Nov 08 21:47:11 user nova-compute[75993]: node.session.timeo.replacement_timeout = 120
Nov 08 21:47:11 user nova-compute[75993]: node.session.err_timeo.abort_timeout = 15
Nov 08 21:47:11 user nova-compute[75993]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 21:47:11 user nova-compute[75993]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 21:47:11 user nova-compute[75993]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 21:47:11 user nova-compute[75993]: node.session.iscsi.FastAbort = Yes
Nov 08 21:47:11 user nova-compute[75993]: node.session.iscsi.InitialR2T = No
Nov 08 21:47:11 user nova-compute[75993]: node.session.iscsi.ImmediateData = Yes
Nov 08 21:47:11 user nova-compute[75993]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 21:47:11 user nova-compute[75993]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 21:47:11 user nova-compute[75993]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 21:47:11 user nova-compute[75993]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 21:47:11 user nova-compute[75993]: node.session.iscsi.MaxConnections = 1
Nov 08 21:47:11 user nova-compute[75993]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 21:47:11 user nova-compute[75993]: node.session.iscsi.ERL = 0
Nov 08 21:47:11 user nova-compute[75993]: node.session.scan = manual
Nov 08 21:47:11 user nova-compute[75993]: node.session.reopen_max = 0
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].address = 172.16.0.220
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].port = 3260
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].startup = manual
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].tcp.window_size = 524288
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].tcp.type_of_service = 0
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].timeo.logout_timeout = 15
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].timeo.login_timeout = 15
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].timeo.auth_timeout = 45
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].iscsi.DataDigest = None
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].iscsi.IFMarker = No
Nov 08 21:47:11 user nova-compute[75993]: node.conn[0].iscsi.OFMarker = No
Nov 08 21:47:11 user nova-compute[75993]: # END RECORD
Nov 08 21:47:11 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e7571f-bbc9-462f-855d-e3c38e728687]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b553083a-6ccd-496b-a2fd-f55561e22d50]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHAZMJuG {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iHAZMJuG" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcd1018-8869-45a0-b0cd-d64a779e1ab4]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iHAZMJuG'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6db59eb-6906-403b-8da4-fbff379da14a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e2d12f-abce-4998-83bd-12d9553faa32]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:12 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:12 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:12 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:12 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:12 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:12 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:12 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:12 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.176s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] HCTL ('36', '0', '0', 0) found on session 27 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d665f0-e7b8-460d-ad8b-de446cf36cd1]: (4, ('0 0 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Searching for a device in session 27 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHAZMJuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.210s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] <== connect_volume: return (211ms) {'type': 'block', 'scsi_wwn': '23633626535383739', 'path': '/dev/sde'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633626535383739', 'path': '/dev/sde'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2110782090',display_name='tempest-ServerStableDeviceRescueTest-server-2110782090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2110782090',id=20,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMN3lC7vsEkbnadUPTnIr2Jya1/3yi+51p6/n72zhb4uMU3OFUR7/aRNmvgHj88ClY4o03jV8JtlakKqT3cQOcLTpQ4HYKpK1Ff1ZAClAyOauC8xW9s99eqeqsUlkqGrw==',key_name='tempest-keypair-1465265887',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:43:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd6082215e9b4000909b766f682d4ea1',ramdisk_id='',reservation_id='r-j02wgz8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-370267439',owner_user_name='tempest-ServerStableDeviceRescueTest-370267439-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3248c726b00543bdb2cb218afbf8d803',uuid=7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "vif_mac": "fa:16:3e:f2:0f:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Converting VIF {"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "vif_mac": "fa:16:3e:f2:0f:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0f:71,bridge_name='br-int',has_traffic_filtering=True,id=0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca,network=Network(8de4945b-2e2b-4b1a-8b14-12dfbe408cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa21b8f-26') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG nova.objects.instance [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG nova.objects.base [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Object Instance<7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:47:12 user nova-compute[75993]:   <uuid>7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2</uuid>
Nov 08 21:47:12 user nova-compute[75993]:   <name>instance-00000014</name>
Nov 08 21:47:12 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:47:12 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:47:12 user nova-compute[75993]:   <metadata>
Nov 08 21:47:12 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:47:12 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:47:12 user nova-compute[75993]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2110782090</nova:name>
Nov 08 21:47:12 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:47:11</nova:creationTime>
Nov 08 21:47:12 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:47:12 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:47:12 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:47:12 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:47:12 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:47:12 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:47:12 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:47:12 user nova-compute[75993]:       <nova:owner>
Nov 08 21:47:12 user nova-compute[75993]:         <nova:user uuid="3248c726b00543bdb2cb218afbf8d803">tempest-ServerStableDeviceRescueTest-370267439-project-member</nova:user>
Nov 08 21:47:12 user nova-compute[75993]:         <nova:project uuid="bd6082215e9b4000909b766f682d4ea1">tempest-ServerStableDeviceRescueTest-370267439</nova:project>
Nov 08 21:47:12 user nova-compute[75993]:       </nova:owner>
Nov 08 21:47:12 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:47:12 user nova-compute[75993]:       <nova:ports>
Nov 08 21:47:12 user nova-compute[75993]:         <nova:port uuid="0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca">
Nov 08 21:47:12 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 21:47:12 user nova-compute[75993]:         </nova:port>
Nov 08 21:47:12 user nova-compute[75993]:       </nova:ports>
Nov 08 21:47:12 user nova-compute[75993]:     </nova:instance>
Nov 08 21:47:12 user nova-compute[75993]:   </metadata>
Nov 08 21:47:12 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:47:12 user nova-compute[75993]:     <system>
Nov 08 21:47:12 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:47:12 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:47:12 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:47:12 user nova-compute[75993]:       <entry name="serial">7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2</entry>
Nov 08 21:47:12 user nova-compute[75993]:       <entry name="uuid">7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2</entry>
Nov 08 21:47:12 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:47:12 user nova-compute[75993]:     </system>
Nov 08 21:47:12 user nova-compute[75993]:   </sysinfo>
Nov 08 21:47:12 user nova-compute[75993]:   <os>
Nov 08 21:47:12 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:47:12 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:47:12 user nova-compute[75993]:   </os>
Nov 08 21:47:12 user nova-compute[75993]:   <features>
Nov 08 21:47:12 user nova-compute[75993]:     <acpi/>
Nov 08 21:47:12 user nova-compute[75993]:     <apic/>
Nov 08 21:47:12 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:47:12 user nova-compute[75993]:   </features>
Nov 08 21:47:12 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:47:12 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:47:12 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:47:12 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:47:12 user nova-compute[75993]:   </clock>
Nov 08 21:47:12 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:47:12 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:47:12 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:47:12 user nova-compute[75993]:   </cpu>
Nov 08 21:47:12 user nova-compute[75993]:   <devices>
Nov 08 21:47:12 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:47:12 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:47:12 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk"/>
Nov 08 21:47:12 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:47:12 user nova-compute[75993]:     </disk>
Nov 08 21:47:12 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:47:12 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:47:12 user nova-compute[75993]:       <source dev="/dev/sde"/>
Nov 08 21:47:12 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:47:12 user nova-compute[75993]:       <serial>db1c38e9-2000-4a04-8b9c-50c7207f6dde</serial>
Nov 08 21:47:12 user nova-compute[75993]:     </disk>
Nov 08 21:47:12 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:47:12 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:47:12 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.rescue"/>
Nov 08 21:47:12 user nova-compute[75993]:       <target dev="vdc" bus="virtio"/>
Nov 08 21:47:12 user nova-compute[75993]:       <boot order="1"/>
Nov 08 21:47:12 user nova-compute[75993]:     </disk>
Nov 08 21:47:12 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:47:12 user nova-compute[75993]:       <mac address="fa:16:3e:f2:0f:71"/>
Nov 08 21:47:12 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:47:12 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:47:12 user nova-compute[75993]:       <target dev="tap0fa21b8f-26"/>
Nov 08 21:47:12 user nova-compute[75993]:     </interface>
Nov 08 21:47:12 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:47:12 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/console.log" append="off"/>
Nov 08 21:47:12 user nova-compute[75993]:     </serial>
Nov 08 21:47:12 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:47:12 user nova-compute[75993]:     <video>
Nov 08 21:47:12 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:47:12 user nova-compute[75993]:     </video>
Nov 08 21:47:12 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:47:12 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:47:12 user nova-compute[75993]:     </rng>
Nov 08 21:47:12 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:47:12 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:47:12 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:47:12 user nova-compute[75993]:     </memballoon>
Nov 08 21:47:12 user nova-compute[75993]:   </devices>
Nov 08 21:47:12 user nova-compute[75993]: </domain>
Nov 08 21:47:12 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:47:12 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Instance destroyed successfully.
Nov 08 21:47:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:47:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] No VIF found with MAC fa:16:3e:f2:0f:71, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:47:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-be789474-fac2-4728-baed-8efcc01b96d8 req-0d42e797-8fee-4e59-9f78-144ec6269802 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be789474-fac2-4728-baed-8efcc01b96d8 req-0d42e797-8fee-4e59-9f78-144ec6269802 service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be789474-fac2-4728-baed-8efcc01b96d8 req-0d42e797-8fee-4e59-9f78-144ec6269802 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-be789474-fac2-4728-baed-8efcc01b96d8 req-0d42e797-8fee-4e59-9f78-144ec6269802 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-be789474-fac2-4728-baed-8efcc01b96d8 req-0d42e797-8fee-4e59-9f78-144ec6269802 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:13 user nova-compute[75993]: WARNING nova.compute.manager [req-be789474-fac2-4728-baed-8efcc01b96d8 req-0d42e797-8fee-4e59-9f78-144ec6269802 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received unexpected event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with vm_state active and task_state rescuing.
Nov 08 21:47:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-5235b894-fb02-4390-ab5d-a091ff8afec2 req-16f31ab0-3770-4e6b-bb56-d86c41b1258d service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5235b894-fb02-4390-ab5d-a091ff8afec2 req-16f31ab0-3770-4e6b-bb56-d86c41b1258d service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5235b894-fb02-4390-ab5d-a091ff8afec2 req-16f31ab0-3770-4e6b-bb56-d86c41b1258d service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5235b894-fb02-4390-ab5d-a091ff8afec2 req-16f31ab0-3770-4e6b-bb56-d86c41b1258d service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-5235b894-fb02-4390-ab5d-a091ff8afec2 req-16f31ab0-3770-4e6b-bb56-d86c41b1258d service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:15 user nova-compute[75993]: WARNING nova.compute.manager [req-5235b894-fb02-4390-ab5d-a091ff8afec2 req-16f31ab0-3770-4e6b-bb56-d86c41b1258d service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received unexpected event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with vm_state active and task_state rescuing.
Nov 08 21:47:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:16 user nova-compute[75993]: DEBUG nova.compute.manager [None req-27f65817-502d-4a0e-bbbe-8d41542bb015 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-3c4ea593-2618-47c7-8fe6-cd3a2d78512c req-1793a608-6cea-4006-9469-33bf60e9a92e service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Received event network-changed-f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-3c4ea593-2618-47c7-8fe6-cd3a2d78512c req-1793a608-6cea-4006-9469-33bf60e9a92e service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Refreshing instance network info cache due to event network-changed-f92989bc-c06f-4a11-a50d-5cd326889521. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3c4ea593-2618-47c7-8fe6-cd3a2d78512c req-1793a608-6cea-4006-9469-33bf60e9a92e service nova] Acquiring lock "refresh_cache-cd48056d-13f0-4d8e-839e-0bd392c60478" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3c4ea593-2618-47c7-8fe6-cd3a2d78512c req-1793a608-6cea-4006-9469-33bf60e9a92e service nova] Acquired lock "refresh_cache-cd48056d-13f0-4d8e-839e-0bd392c60478" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG nova.network.neutron [req-3c4ea593-2618-47c7-8fe6-cd3a2d78512c req-1793a608-6cea-4006-9469-33bf60e9a92e service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Refreshing network info cache for port f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG nova.network.neutron [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Port 787ea6de-4603-481a-8262-d51b1ed365da binding to destination host user is already ACTIVE {{(pid=75993) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquired lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG nova.network.neutron [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG nova.network.neutron [req-3c4ea593-2618-47c7-8fe6-cd3a2d78512c req-1793a608-6cea-4006-9469-33bf60e9a92e service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Updated VIF entry in instance network info cache for port f92989bc-c06f-4a11-a50d-5cd326889521. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG nova.network.neutron [req-3c4ea593-2618-47c7-8fe6-cd3a2d78512c req-1793a608-6cea-4006-9469-33bf60e9a92e service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Updating instance_info_cache with network_info: [{"id": "f92989bc-c06f-4a11-a50d-5cd326889521", "address": "fa:16:3e:4d:61:3f", "network": {"id": "4e37144e-bc46-459b-b0ea-23789861dc06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1693242984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26368a5aad0648e197d89fb1b7d5f2ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92989bc-c0", "ovs_interfaceid": "f92989bc-c06f-4a11-a50d-5cd326889521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3c4ea593-2618-47c7-8fe6-cd3a2d78512c req-1793a608-6cea-4006-9469-33bf60e9a92e service nova] Releasing lock "refresh_cache-cd48056d-13f0-4d8e-839e-0bd392c60478" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG nova.network.neutron [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance_info_cache with network_info: [{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Releasing lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Creating tmpfile /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/tmp0z00lxhq to verify with other compute node that the instance is on the same shared storage. {{(pid=75993) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 08 21:47:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-c74f444c-c4c7-42d1-b486-8c21b097a827 req-01f49f1e-1b58-4855-953d-de414f44ba7c service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-unplugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c74f444c-c4c7-42d1-b486-8c21b097a827 req-01f49f1e-1b58-4855-953d-de414f44ba7c service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c74f444c-c4c7-42d1-b486-8c21b097a827 req-01f49f1e-1b58-4855-953d-de414f44ba7c service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c74f444c-c4c7-42d1-b486-8c21b097a827 req-01f49f1e-1b58-4855-953d-de414f44ba7c service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-c74f444c-c4c7-42d1-b486-8c21b097a827 req-01f49f1e-1b58-4855-953d-de414f44ba7c service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-unplugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:20 user nova-compute[75993]: WARNING nova.compute.manager [req-c74f444c-c4c7-42d1-b486-8c21b097a827 req-01f49f1e-1b58-4855-953d-de414f44ba7c service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received unexpected event network-vif-unplugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with vm_state resized and task_state resize_reverting.
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lazy-loading 'flavor' on Instance uuid cd48056d-13f0-4d8e-839e-0bd392c60478 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:20 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance destroyed successfully.
Nov 08 21:47:20 user nova-compute[75993]: DEBUG nova.objects.instance [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lazy-loading 'resources' on Instance uuid f828891c-fc9f-4d73-8467-2fa0a804ffb0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1114912217',display_name='tempest-ServerActionsTestOtherB-server-1114912217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1114912217',id=16,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGWTKmgE74K9m4nW1Iy7drLyphNyDCWQasfONZutGXOVXbF1PlyC04hFpQCnQRFF8F4wUrmwbqu5NeLi338UFqYkZR8X28Kaoc+ZAStDMMSeZsea49hDL5j+Ud29ai6ZA==',key_name='tempest-keypair-19398814',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:46:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f53e802f4154acca8aa60dd0961a959',ramdisk_id='',reservation_id='r-5fh0kiuj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900540301',owner_user_name='tempest-ServerActionsTestOtherB-1900540301-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:46:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b800131f464e52a3b4319038d1a23a',uuid=f828891c-fc9f-4d73-8467-2fa0a804ffb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converting VIF {"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_vif [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap787ea6de-46, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1d46c2e-1bae-4db2-a874-23333d87d3cd) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:20 user nova-compute[75993]: INFO os_vif [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46')
Nov 08 21:47:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELqlHWRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:47:20 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa36f17-41e9-4d05-b276-c25276a0ce0c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:47:20 user nova-compute[75993]: No targets found.
Nov 08 21:47:20 user nova-compute[75993]: iSNS:
Nov 08 21:47:20 user nova-compute[75993]: No targets found.
Nov 08 21:47:20 user nova-compute[75993]: STATIC:
Nov 08 21:47:20 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:47:20 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:47:20 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:47:20 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7
Nov 08 21:47:20 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:47:20 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:47:20 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde
Nov 08 21:47:20 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:47:20 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:47:20 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0
Nov 08 21:47:20 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:47:20 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:47:20 user nova-compute[75993]: FIRMWARE:
Nov 08 21:47:20 user nova-compute[75993]: No targets found.
Nov 08 21:47:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:47:20 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:47:20 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:20 user nova-compute[75993]: INFO nova.compute.manager [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Attaching volume 4882f793-6849-460b-ae8c-958f62df6e9c to /dev/vdb
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f1336a-5b97-480b-87dc-5bee5c28258e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1d4cc6-b65d-4320-9632-ad80f7affa24]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:20 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:20 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:20 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:20 user nova-compute[75993]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:20 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:20 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8568466320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.utils [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e06239c-d476-4f07-959b-6e8afcd9b168]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad4b919-44d9-4b67-8a7b-5cfdb75a9b4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d0c725-e038-4097-8f38-4037079269b4]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4226b289-1111-44ca-825f-47e1b01408c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8f3bc3-2179-481f-827d-e808eef194ff]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7865696e-2163-4e76-8671-52649b120521]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab7e1ed-fb23-4f9e-8fd9-8c8b1b837521]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf4aeee-8f7f-4c62-ab03-6d82cdff3d1d]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:47:21 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:47:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b76d1e8-6af0-4139-a4bd-eb48dd55cc5e]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG os_brick.utils [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] <== get_connector_properties: return (180ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Updating existing volume attachment record: f08eba89-dce8-4c0f-962c-e259e19c8226 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[240a4791-e8ec-4a67-af67-3bb2eb659311]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeed03a7-5f49-4146-86cf-ee65be9227b9]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]
Nov 08 21:47:21 user nova-compute[75993]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.
Nov 08 21:47:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[491b1bbd-bce0-44ef-8f44-9d9bccf68253]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] <== disconnect_volume: return (421ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:47:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-296a73a0-7f2c-4e61-acca-96c275c6955c req-74331e8c-5186-4de6-8971-33f61b80f720 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-296a73a0-7f2c-4e61-acca-96c275c6955c req-74331e8c-5186-4de6-8971-33f61b80f720 service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-296a73a0-7f2c-4e61-acca-96c275c6955c req-74331e8c-5186-4de6-8971-33f61b80f720 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-296a73a0-7f2c-4e61-acca-96c275c6955c req-74331e8c-5186-4de6-8971-33f61b80f720 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-296a73a0-7f2c-4e61-acca-96c275c6955c req-74331e8c-5186-4de6-8971-33f61b80f720 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:22 user nova-compute[75993]: WARNING nova.compute.manager [req-296a73a0-7f2c-4e61-acca-96c275c6955c req-74331e8c-5186-4de6-8971-33f61b80f720 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received unexpected event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with vm_state resized and task_state resize_reverting.
Nov 08 21:47:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG nova.objects.instance [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lazy-loading 'migration_context' on Instance uuid f828891c-fc9f-4d73-8467-2fa0a804ffb0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG nova.objects.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Object Instance<f828891c-fc9f-4d73-8467-2fa0a804ffb0> lazy-loaded attributes: resources,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-84773667-77d5-4475-b8c2-152b32644435 req-ca3243a6-8ab4-4113-be69-2702fc879f91 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Received event network-changed-f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-84773667-77d5-4475-b8c2-152b32644435 req-ca3243a6-8ab4-4113-be69-2702fc879f91 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Refreshing instance network info cache due to event network-changed-f1990007-cd9f-4690-a4ab-b9db8ff871e3. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-84773667-77d5-4475-b8c2-152b32644435 req-ca3243a6-8ab4-4113-be69-2702fc879f91 service nova] Acquiring lock "refresh_cache-a3c86d97-9bc3-45a0-98da-9dbc56890b78" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-84773667-77d5-4475-b8c2-152b32644435 req-ca3243a6-8ab4-4113-be69-2702fc879f91 service nova] Acquired lock "refresh_cache-a3c86d97-9bc3-45a0-98da-9dbc56890b78" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG nova.network.neutron [req-84773667-77d5-4475-b8c2-152b32644435 req-ca3243a6-8ab4-4113-be69-2702fc879f91 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Refreshing network info cache for port f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:22 user nova-compute[75993]: DEBUG nova.objects.instance [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lazy-loading 'flavor' on Instance uuid a3c86d97-9bc3-45a0-98da-9dbc56890b78 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Ignoring supplied device name: /dev/vdb
Nov 08 21:47:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:23 user nova-compute[75993]: INFO nova.compute.manager [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Attaching volume 7c714742-3ee9-4c13-9343-b4490058e526 to /dev/vdb
Nov 08 21:47:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-84773667-77d5-4475-b8c2-152b32644435 req-ca3243a6-8ab4-4113-be69-2702fc879f91 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Updated VIF entry in instance network info cache for port f1990007-cd9f-4690-a4ab-b9db8ff871e3. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-84773667-77d5-4475-b8c2-152b32644435 req-ca3243a6-8ab4-4113-be69-2702fc879f91 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Updating instance_info_cache with network_info: [{"id": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "address": "fa:16:3e:8c:43:91", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1990007-cd", "ovs_interfaceid": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.743s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-84773667-77d5-4475-b8c2-152b32644435 req-ca3243a6-8ab4-4113-be69-2702fc879f91 service nova] Releasing lock "refresh_cache-a3c86d97-9bc3-45a0-98da-9dbc56890b78" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG os_brick.utils [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72239d4-47b8-462f-b673-b52b0217a2aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7e8007-89f6-4cb3-bf57-f7b9b3cd27f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[164835ca-81a5-4ed9-ac2a-ecb8b7c57a53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[960ddd15-f8c6-4621-990e-300ef2bc7671]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:47:23 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa61708-14b1-4220-adf2-4a4ac4832409]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG os_brick.utils [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Updating existing volume attachment record: c9bd81c7-2b8d-48f0-b72b-b84f87a92781 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:47:23 user nova-compute[75993]: INFO nova.compute.manager [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Swapping old allocation on dict_keys(['4677e2dc-e2f1-4c4a-b853-94006ef06d81']) held by migration 7b299dd2-f2e1-4642-a3a8-a15f0ed5130b for instance
Nov 08 21:47:23 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Overwriting current allocation {'allocations': {'4677e2dc-e2f1-4c4a-b853-94006ef06d81': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 32}}, 'project_id': '3f53e802f4154acca8aa60dd0961a959', 'user_id': '80b800131f464e52a3b4319038d1a23a', 'consumer_generation': 1} on consumer f828891c-fc9f-4d73-8467-2fa0a804ffb0 {{(pid=75993) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquired lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:47:23 user nova-compute[75993]: DEBUG nova.network.neutron [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG nova.network.neutron [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance_info_cache with network_info: [{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Releasing lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG os_brick.utils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ef6441-2a13-4a74-82ca-6384568b71a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[52400112-6cc0-4e08-8662-cce48faac952]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[17777a77-1bef-46e8-9f0f-540548b79342]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e53205-de06-47e1-9abe-20b0fb251c77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:47:24 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:47:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed07ce0-f5fd-47ce-804c-27cc2e0bd0c8]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:47:24 user nova-compute[75993]: DEBUG os_brick.utils [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:47:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYsVoQeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:47:48 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:48 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:48 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a221f74-b832-4c4b-a9b7-0a588b41ef2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:47:48 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eb2f7b-e2a1-47e9-8dc5-c7c52bb93e86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526] added
Nov 08 21:47:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e32e17-0b12-41ae-81ac-63d9507bf6b5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8b5d22-818c-41da-9362-26b4d20d6970]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BYsVoQeS {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BYsVoQeS" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ea212-a905-4625-8676-7dfcc9ed9e45]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BYsVoQeS'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8837dc-707e-44a1-9727-1c8bb2261411]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[acce24df-3374-4876-bc9d-b3d933636ec8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:48 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:48 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:48 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:48 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c542c783-12d5-4462-8819-d25f3e37ca57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526, portal: 172.16.0.220,3260]
Nov 08 21:47:48 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526, portal: 172.16.0.220,3260] successful.
Nov 08 21:47:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad78a4f-20ef-4dd3-a0bb-6017e350fdac]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1a5ffa-68b7-419f-8396-87dca4543aae]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:48 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:48 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:48 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:48 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:48 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:48 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:48 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68ac54a-4750-4112-b1f0-3f9559fba117]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:47:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYsVoQeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:47:49 user nova-compute[75993]: INFO nova.compute.manager [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Rescuing
Nov 08 21:47:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquired lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.network.neutron [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Starting finish_revert_migration {{(pid=75993) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Start _get_guest_xml network_info=[{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '2df86896-5d39-432e-8d45-8334ced1603c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELqlHWRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f828891c-fc9f-4d73-8467-2fa0a804ffb0', 'attached_at': '2023-11-08T21:47:50.000000', 'detached_at': '', 'volume_id': '5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'serial': '5aecdf48-bd8b-4f46-acc9-012c71b590f0'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:47:49 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:47:49 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.network.neutron [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updating instance_info_cache with network_info: [{"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.objects.instance [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lazy-loading 'vcpu_model' on Instance uuid f828891c-fc9f-4d73-8467-2fa0a804ffb0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Releasing lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELqlHWRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:47:49 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23638646536613337', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638646536613337', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.120s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:49 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:49 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:47:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.objects.instance [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lazy-loading 'flavor' on Instance uuid a3c86d97-9bc3-45a0-98da-9dbc56890b78 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0554aa7-0e13-4c54-8e90-d0b68fa3f434]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:47:49 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:47:49 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:47:49 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 21:47:49 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:47:49 user nova-compute[75993]:   <serial>7c714742-3ee9-4c13-9343-b4490058e526</serial>
Nov 08 21:47:49 user nova-compute[75993]: </disk>
Nov 08 21:47:49 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c32010-32ca-49b9-98ac-e187c6c5f7cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0] added
Nov 08 21:47:49 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f1936f-0fc3-428c-9ad6-3efecede60d0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fff274-7152-45ee-9d4f-809ca494b845]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELqlHWRP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELqlHWRP" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15e3809-dd0f-4625-98f4-e7bd99694a85]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELqlHWRP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5657e454-bcdc-4717-bfb3-a8deafd0ce94]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bf0d72-e2ab-467c-8478-a61894bf3970]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-295d69b8-6e60-4b53-a10d-3dde3e8e9c42 req-346c2989-d6f2-49c5-8f79-8dd03aa18ac7 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-unplugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-295d69b8-6e60-4b53-a10d-3dde3e8e9c42 req-346c2989-d6f2-49c5-8f79-8dd03aa18ac7 service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-295d69b8-6e60-4b53-a10d-3dde3e8e9c42 req-346c2989-d6f2-49c5-8f79-8dd03aa18ac7 service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-295d69b8-6e60-4b53-a10d-3dde3e8e9c42 req-346c2989-d6f2-49c5-8f79-8dd03aa18ac7 service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-295d69b8-6e60-4b53-a10d-3dde3e8e9c42 req-346c2989-d6f2-49c5-8f79-8dd03aa18ac7 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-unplugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:50 user nova-compute[75993]: WARNING nova.compute.manager [req-295d69b8-6e60-4b53-a10d-3dde3e8e9c42 req-346c2989-d6f2-49c5-8f79-8dd03aa18ac7 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received unexpected event network-vif-unplugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with vm_state active and task_state rescuing.
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4794e8fa-13d1-49ee-8625-9053ef5f832c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]
Nov 08 21:47:50 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.
Nov 08 21:47:50 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df70622-6eec-4f56-bb1a-93c5a4e0fae7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88d2698-079d-4a91-89e5-688ca50d885c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:50 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] HCTL ('37', '-', '-', 0) found on session 29 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[168b9de5-afc1-4fc6-abc2-7ab9bac24886]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] No VIF found with MAC fa:16:3e:8c:43:91, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cd06eb18-c588-46a6-9860-e66ebfa15af6 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.410s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Instance destroyed successfully.
Nov 08 21:47:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Attempting a stable device rescue
Nov 08 21:47:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75993) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Instance directory exists: not creating {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 21:47:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Creating image(s)
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "/opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "/opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "/opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG nova.objects.instance [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'trusted_certs' on Instance uuid 64d8c15c-0ac9-434b-852a-123a940dc0ae {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "4efdf792ad4b2cb1bebcab9025476948969ef1d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "4efdf792ad4b2cb1bebcab9025476948969ef1d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7.part --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Searching for a device in session 29 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELqlHWRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.843s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] <== connect_volume: return (1963ms) {'type': 'block', 'scsi_wwn': '26461333534623164', 'path': '/dev/sdf'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461333534623164', 'path': '/dev/sdf'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1114912217',display_name='tempest-ServerActionsTestOtherB-server-1114912217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1114912217',id=16,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGWTKmgE74K9m4nW1Iy7drLyphNyDCWQasfONZutGXOVXbF1PlyC04hFpQCnQRFF8F4wUrmwbqu5NeLi338UFqYkZR8X28Kaoc+ZAStDMMSeZsea49hDL5j+Ud29ai6ZA==',key_name='tempest-keypair-19398814',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:46:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f53e802f4154acca8aa60dd0961a959',ramdisk_id='',reservation_id='r-5fh0kiuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900540301',owner_user_name='tempest-ServerActionsTestOtherB-1900540301-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b800131f464e52a3b4319038d1a23a',uuid=f828891c-fc9f-4d73-8467-2fa0a804ffb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converting VIF {"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:47:51 user nova-compute[75993]:   <uuid>f828891c-fc9f-4d73-8467-2fa0a804ffb0</uuid>
Nov 08 21:47:51 user nova-compute[75993]:   <name>instance-00000010</name>
Nov 08 21:47:51 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:47:51 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:47:51 user nova-compute[75993]:   <metadata>
Nov 08 21:47:51 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:47:51 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:47:51 user nova-compute[75993]:       <nova:name>tempest-ServerActionsTestOtherB-server-1114912217</nova:name>
Nov 08 21:47:51 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:47:49</nova:creationTime>
Nov 08 21:47:51 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:47:51 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:47:51 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:47:51 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:47:51 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:47:51 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:47:51 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:47:51 user nova-compute[75993]:       <nova:owner>
Nov 08 21:47:51 user nova-compute[75993]:         <nova:user uuid="80b800131f464e52a3b4319038d1a23a">tempest-ServerActionsTestOtherB-1900540301-project-member</nova:user>
Nov 08 21:47:51 user nova-compute[75993]:         <nova:project uuid="3f53e802f4154acca8aa60dd0961a959">tempest-ServerActionsTestOtherB-1900540301</nova:project>
Nov 08 21:47:51 user nova-compute[75993]:       </nova:owner>
Nov 08 21:47:51 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:47:51 user nova-compute[75993]:       <nova:ports>
Nov 08 21:47:51 user nova-compute[75993]:         <nova:port uuid="787ea6de-4603-481a-8262-d51b1ed365da">
Nov 08 21:47:51 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 21:47:51 user nova-compute[75993]:         </nova:port>
Nov 08 21:47:51 user nova-compute[75993]:       </nova:ports>
Nov 08 21:47:51 user nova-compute[75993]:     </nova:instance>
Nov 08 21:47:51 user nova-compute[75993]:   </metadata>
Nov 08 21:47:51 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:47:51 user nova-compute[75993]:     <system>
Nov 08 21:47:51 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:47:51 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:47:51 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:47:51 user nova-compute[75993]:       <entry name="serial">f828891c-fc9f-4d73-8467-2fa0a804ffb0</entry>
Nov 08 21:47:51 user nova-compute[75993]:       <entry name="uuid">f828891c-fc9f-4d73-8467-2fa0a804ffb0</entry>
Nov 08 21:47:51 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:47:51 user nova-compute[75993]:     </system>
Nov 08 21:47:51 user nova-compute[75993]:   </sysinfo>
Nov 08 21:47:51 user nova-compute[75993]:   <os>
Nov 08 21:47:51 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:47:51 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:47:51 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:47:51 user nova-compute[75993]:   </os>
Nov 08 21:47:51 user nova-compute[75993]:   <features>
Nov 08 21:47:51 user nova-compute[75993]:     <acpi/>
Nov 08 21:47:51 user nova-compute[75993]:     <apic/>
Nov 08 21:47:51 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:47:51 user nova-compute[75993]:   </features>
Nov 08 21:47:51 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:47:51 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:47:51 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:47:51 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:47:51 user nova-compute[75993]:   </clock>
Nov 08 21:47:51 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:47:51 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:47:51 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:47:51 user nova-compute[75993]:   </cpu>
Nov 08 21:47:51 user nova-compute[75993]:   <devices>
Nov 08 21:47:51 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:47:51 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:47:51 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk"/>
Nov 08 21:47:51 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:47:51 user nova-compute[75993]:     </disk>
Nov 08 21:47:51 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:47:51 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:47:51 user nova-compute[75993]:       <source dev="/dev/sdf"/>
Nov 08 21:47:51 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:47:51 user nova-compute[75993]:       <serial>5aecdf48-bd8b-4f46-acc9-012c71b590f0</serial>
Nov 08 21:47:51 user nova-compute[75993]:     </disk>
Nov 08 21:47:51 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:47:51 user nova-compute[75993]:       <mac address="fa:16:3e:ed:c9:e3"/>
Nov 08 21:47:51 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:47:51 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:47:51 user nova-compute[75993]:       <target dev="tap787ea6de-46"/>
Nov 08 21:47:51 user nova-compute[75993]:     </interface>
Nov 08 21:47:51 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:47:51 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/console.log" append="off"/>
Nov 08 21:47:51 user nova-compute[75993]:     </serial>
Nov 08 21:47:51 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:47:51 user nova-compute[75993]:     <video>
Nov 08 21:47:51 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:47:51 user nova-compute[75993]:     </video>
Nov 08 21:47:51 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:47:51 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:47:51 user nova-compute[75993]:     </rng>
Nov 08 21:47:51 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:47:51 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:47:51 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:47:51 user nova-compute[75993]:     </memballoon>
Nov 08 21:47:51 user nova-compute[75993]:   </devices>
Nov 08 21:47:51 user nova-compute[75993]: </domain>
Nov 08 21:47:51 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1114912217',display_name='tempest-ServerActionsTestOtherB-server-1114912217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1114912217',id=16,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGWTKmgE74K9m4nW1Iy7drLyphNyDCWQasfONZutGXOVXbF1PlyC04hFpQCnQRFF8F4wUrmwbqu5NeLi338UFqYkZR8X28Kaoc+ZAStDMMSeZsea49hDL5j+Ud29ai6ZA==',key_name='tempest-keypair-19398814',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:46:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3f53e802f4154acca8aa60dd0961a959',ramdisk_id='',reservation_id='r-5fh0kiuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1900540301',owner_user_name='tempest-ServerActionsTestOtherB-1900540301-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b800131f464e52a3b4319038d1a23a',uuid=f828891c-fc9f-4d73-8467-2fa0a804ffb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converting VIF {"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG os_vif [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67636169-554c-564b-8308-221a0647e372', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap787ea6de-46, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap787ea6de-46, col_values=(('qos', UUID('c50e1e22-9ba5-4402-9f4d-6f0f44f8d398')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap787ea6de-46, col_values=(('external_ids', {'iface-id': '787ea6de-4603-481a-8262-d51b1ed365da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:c9:e3', 'vm-uuid': 'f828891c-fc9f-4d73-8467-2fa0a804ffb0'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:51 user nova-compute[75993]: INFO os_vif [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46')
Nov 08 21:47:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG nova.virt.images [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] f974e8b3-22f1-415a-b56b-fdc1bff31352 was qcow2, converting to raw {{(pid=75993) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:47:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7.part /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7.converted {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BhPbcVde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:47:52 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:52 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:52 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd93aa92-ba5c-4f19-b202-de9276fb0fba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:47:52 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.118s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1512484-d204-4382-86a7-65b03846ceae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c] added
Nov 08 21:47:52 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-0a51fb61-8f41-42d8-bb71-6d39a96b8df1 req-c32a0b8a-2d25-48bd-8bfc-6a2ad580399b service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0a51fb61-8f41-42d8-bb71-6d39a96b8df1 req-c32a0b8a-2d25-48bd-8bfc-6a2ad580399b service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0a51fb61-8f41-42d8-bb71-6d39a96b8df1 req-c32a0b8a-2d25-48bd-8bfc-6a2ad580399b service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0a51fb61-8f41-42d8-bb71-6d39a96b8df1 req-c32a0b8a-2d25-48bd-8bfc-6a2ad580399b service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-0a51fb61-8f41-42d8-bb71-6d39a96b8df1 req-c32a0b8a-2d25-48bd-8bfc-6a2ad580399b service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:52 user nova-compute[75993]: WARNING nova.compute.manager [req-0a51fb61-8f41-42d8-bb71-6d39a96b8df1 req-c32a0b8a-2d25-48bd-8bfc-6a2ad580399b service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received unexpected event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with vm_state active and task_state rescuing.
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02bcc80-8c3f-4434-b0f4-2650dd2f302a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.092s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecda840c-af3b-41d1-81bd-4ac39e2007b8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BhPbcVde {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7.part /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7.converted" returned: 0 in 0.396s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7.converted --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BhPbcVde" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[186f31af-2c16-43f4-8262-b1fd0c1cf5c2]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BhPbcVde'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[194a9cad-3568-4ac0-8be3-9b08de871f0e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc4f3d0-07e0-4b9a-8f3c-999d61c2b6da]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c6ad9a-22fb-4823-b5f3-87cc1411ab14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c, portal: 172.16.0.220,3260]
Nov 08 21:47:52 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c, portal: 172.16.0.220,3260] successful.
Nov 08 21:47:52 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "4efdf792ad4b2cb1bebcab9025476948969ef1d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.831s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "4efdf792ad4b2cb1bebcab9025476948969ef1d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "4efdf792ad4b2cb1bebcab9025476948969ef1d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f5cf07-0ad7-43c5-8d4c-e1340f869cc7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cce2132-6b71-4433-bd7f-a364f5b8ed8b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:47:52 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:52 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:47:52 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.589s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] HCTL ('38', '-', '-', 0) found on session 30 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[16167002-f76e-4aab-a757-ce5a4bfdd1e7]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Searching for a device in session 30 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BhPbcVde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7 --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7,backing_fmt=raw /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.rescue {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7,backing_fmt=raw /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.rescue" returned: 0 in 0.051s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "4efdf792ad4b2cb1bebcab9025476948969ef1d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.objects.instance [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'migration_context' on Instance uuid 64d8c15c-0ac9-434b-852a-123a940dc0ae {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.objects.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Object Instance<64d8c15c-0ac9-434b-852a-123a940dc0ae> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Start _get_guest_xml network_info=[{"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "vif_mac": "fa:16:3e:5e:6e:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f974e8b3-22f1-415a-b56b-fdc1bff31352', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'db5542db-be9b-4267-b9b3-e7a84dccfbc9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLxGMFWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '64d8c15c-0ac9-434b-852a-123a940dc0ae', 'attached_at': '', 'detached_at': '', 'volume_id': '567f6f9e-3314-4f87-853f-7786f54a9ab3', 'serial': '567f6f9e-3314-4f87-853f-7786f54a9ab3'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.objects.instance [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'resources' on Instance uuid 64d8c15c-0ac9-434b-852a-123a940dc0ae {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.objects.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Object Instance<64d8c15c-0ac9-434b-852a-123a940dc0ae> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.objects.instance [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'numa_topology' on Instance uuid 64d8c15c-0ac9-434b-852a-123a940dc0ae {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.objects.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Object Instance<64d8c15c-0ac9-434b-852a-123a940dc0ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:47:52 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:47:52 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.objects.instance [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'vcpu_model' on Instance uuid 64d8c15c-0ac9-434b-852a-123a940dc0ae {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.objects.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Object Instance<64d8c15c-0ac9-434b-852a-123a940dc0ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLxGMFWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:47:52 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.630s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] <== connect_volume: return (1632ms) {'type': 'block', 'scsi_wwn': '26530336461353237', 'path': '/dev/sdg'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530336461353237', 'path': '/dev/sdg'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.763s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:53 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:47:53 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lazy-loading 'flavor' on Instance uuid cd48056d-13f0-4d8e-839e-0bd392c60478 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9611bfe7-4a23-49b4-9592-7d747799c110]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = TLxGMFWg\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 21:47:53 user nova-compute[75993]: node.name = iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:47:53 user nova-compute[75993]: node.tpgt = -1
Nov 08 21:47:53 user nova-compute[75993]: node.startup = automatic
Nov 08 21:47:53 user nova-compute[75993]: node.leading_login = No
Nov 08 21:47:53 user nova-compute[75993]: iface.iscsi_ifacename = default
Nov 08 21:47:53 user nova-compute[75993]: iface.net_ifacename = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.ipaddress = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.prefix_len = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.hwaddress = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.transport_name = tcp
Nov 08 21:47:53 user nova-compute[75993]: iface.initiatorname = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.state = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.vlan_id = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.vlan_priority = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.vlan_state = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.iface_num = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.mtu = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.port = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.bootproto = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.subnet_mask = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.gateway = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.dhcp_alt_client_id = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.dhcp_dns = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.dhcp_learn_iqn = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.dhcp_vendor_id_state = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.dhcp_vendor_id = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.dhcp_slp_da = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.fragmentation = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.gratuitous_arp = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.incoming_forwarding = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.tos_state = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.tos = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.ttl = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.delayed_ack = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.tcp_nagle = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.tcp_wsf_state = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.tcp_wsf = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.tcp_timer_scale = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.tcp_timestamp = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.redirect = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.def_task_mgmt_timeout = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.header_digest = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.data_digest = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.immediate_data = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.initial_r2t = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.data_seq_inorder = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.data_pdu_inorder = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.erl = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.max_receive_data_len = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.first_burst_len = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.max_outstanding_r2t = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.max_burst_len = 0
Nov 08 21:47:53 user nova-compute[75993]: iface.chap_auth = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.bidi_chap = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.strict_login_compliance = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.discovery_auth = <empty>
Nov 08 21:47:53 user nova-compute[75993]: iface.discovery_logout = <empty>
Nov 08 21:47:53 user nova-compute[75993]: node.discovery_address = <empty>
Nov 08 21:47:53 user nova-compute[75993]: node.discovery_port = 0
Nov 08 21:47:53 user nova-compute[75993]: node.discovery_type = static
Nov 08 21:47:53 user nova-compute[75993]: node.session.initial_cmdsn = 0
Nov 08 21:47:53 user nova-compute[75993]: node.session.initial_login_retry_max = 8
Nov 08 21:47:53 user nova-compute[75993]: node.session.xmit_thread_priority = -20
Nov 08 21:47:53 user nova-compute[75993]: node.session.cmds_max = 128
Nov 08 21:47:53 user nova-compute[75993]: node.session.queue_depth = 32
Nov 08 21:47:53 user nova-compute[75993]: node.session.nr_sessions = 1
Nov 08 21:47:53 user nova-compute[75993]: node.session.auth.authmethod = CHAP
Nov 08 21:47:53 user nova-compute[75993]: node.session.auth.username = TLxGMFWg
Nov 08 21:47:53 user nova-compute[75993]: node.session.auth.password = ***
Nov 08 21:47:53 user nova-compute[75993]: node.session.auth.username_in = <empty>
Nov 08 21:47:53 user nova-compute[75993]: node.session.auth.password_in = <empty>
Nov 08 21:47:53 user nova-compute[75993]: node.session.auth.chap_algs = MD5
Nov 08 21:47:53 user nova-compute[75993]: node.session.timeo.replacement_timeout = 120
Nov 08 21:47:53 user nova-compute[75993]: node.session.err_timeo.abort_timeout = 15
Nov 08 21:47:53 user nova-compute[75993]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 21:47:53 user nova-compute[75993]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 21:47:53 user nova-compute[75993]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 21:47:53 user nova-compute[75993]: node.session.iscsi.FastAbort = Yes
Nov 08 21:47:53 user nova-compute[75993]: node.session.iscsi.InitialR2T = No
Nov 08 21:47:53 user nova-compute[75993]: node.session.iscsi.ImmediateData = Yes
Nov 08 21:47:53 user nova-compute[75993]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 21:47:53 user nova-compute[75993]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 21:47:53 user nova-compute[75993]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 21:47:53 user nova-compute[75993]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 21:47:53 user nova-compute[75993]: node.session.iscsi.MaxConnections = 1
Nov 08 21:47:53 user nova-compute[75993]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 21:47:53 user nova-compute[75993]: node.session.iscsi.ERL = 0
Nov 08 21:47:53 user nova-compute[75993]: node.session.scan = manual
Nov 08 21:47:53 user nova-compute[75993]: node.session.reopen_max = 0
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].address = 172.16.0.220
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].port = 3260
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].startup = manual
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].tcp.window_size = 524288
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].tcp.type_of_service = 0
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].timeo.logout_timeout = 15
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].timeo.login_timeout = 15
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].timeo.auth_timeout = 45
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].iscsi.DataDigest = None
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].iscsi.IFMarker = No
Nov 08 21:47:53 user nova-compute[75993]: node.conn[0].iscsi.OFMarker = No
Nov 08 21:47:53 user nova-compute[75993]: # END RECORD
Nov 08 21:47:53 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:47:53 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:47:53 user nova-compute[75993]:   <source dev="/dev/sdg"/>
Nov 08 21:47:53 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:47:53 user nova-compute[75993]:   <serial>4882f793-6849-460b-ae8c-958f62df6e9c</serial>
Nov 08 21:47:53 user nova-compute[75993]: </disk>
Nov 08 21:47:53 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[022900b1-2485-40e8-bb11-77d39258f22f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.compute.manager [req-7dd3ae29-9698-43c3-b5d6-1d86bc300c21 req-fac9e68f-df50-4037-8cdd-d3c56d94e65a service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7dd3ae29-9698-43c3-b5d6-1d86bc300c21 req-fac9e68f-df50-4037-8cdd-d3c56d94e65a service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7dd3ae29-9698-43c3-b5d6-1d86bc300c21 req-fac9e68f-df50-4037-8cdd-d3c56d94e65a service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7dd3ae29-9698-43c3-b5d6-1d86bc300c21 req-fac9e68f-df50-4037-8cdd-d3c56d94e65a service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.compute.manager [req-7dd3ae29-9698-43c3-b5d6-1d86bc300c21 req-fac9e68f-df50-4037-8cdd-d3c56d94e65a service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:53 user nova-compute[75993]: WARNING nova.compute.manager [req-7dd3ae29-9698-43c3-b5d6-1d86bc300c21 req-fac9e68f-df50-4037-8cdd-d3c56d94e65a service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received unexpected event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with vm_state resized and task_state resize_reverting.
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2254cb86-b509-4529-ba2b-5bfdc17a286a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLxGMFWg {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TLxGMFWg" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf7bcfa-ceb9-4bae-a3eb-13aeb77aa1a6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TLxGMFWg'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f664f9b1-bef2-417e-9d46-f60110c65a71]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fed89d-a93e-49c0-8961-fa365d9c27f7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:53 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:53 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:53 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:53 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:53 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:47:53 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:47:53 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:47:53 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:47:53 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:47:53 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:47:53 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:47:53 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.174s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] HCTL ('35', '0', '0', 0) found on session 26 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a9a4a7-cf20-41d8-b043-40ab14987126]: (4, ('0 0 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching for a device in session 26 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLxGMFWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.203s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] <== connect_volume: return (966ms) {'type': 'block', 'scsi_wwn': '23663633063356237', 'path': '/dev/sdd'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663633063356237', 'path': '/dev/sdd'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1354744541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1354744541',id=25,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:46:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-ekc9sy6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:46:25Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=64d8c15c-0ac9-434b-852a-123a940dc0ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "vif_mac": "fa:16:3e:5e:6e:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "vif_mac": "fa:16:3e:5e:6e:60"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:6e:60,bridge_name='br-int',has_traffic_filtering=True,id=6e1733d1-86b8-4b78-b2a1-830ac109f583,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e1733d1-86') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.objects.instance [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'pci_devices' on Instance uuid 64d8c15c-0ac9-434b-852a-123a940dc0ae {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.objects.base [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Object Instance<64d8c15c-0ac9-434b-852a-123a940dc0ae> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:47:53 user nova-compute[75993]:   <uuid>64d8c15c-0ac9-434b-852a-123a940dc0ae</uuid>
Nov 08 21:47:53 user nova-compute[75993]:   <name>instance-00000019</name>
Nov 08 21:47:53 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:47:53 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:47:53 user nova-compute[75993]:   <metadata>
Nov 08 21:47:53 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:47:53 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:47:53 user nova-compute[75993]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1354744541</nova:name>
Nov 08 21:47:53 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:47:52</nova:creationTime>
Nov 08 21:47:53 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:47:53 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:47:53 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:47:53 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:47:53 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:47:53 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:47:53 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:47:53 user nova-compute[75993]:       <nova:owner>
Nov 08 21:47:53 user nova-compute[75993]:         <nova:user uuid="78965be8230646288b7fc0443c3f4f6c">tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member</nova:user>
Nov 08 21:47:53 user nova-compute[75993]:         <nova:project uuid="fb1547c59f8e4d85ad6f650b01243357">tempest-ServerBootFromVolumeStableRescueTest-571934265</nova:project>
Nov 08 21:47:53 user nova-compute[75993]:       </nova:owner>
Nov 08 21:47:53 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:47:53 user nova-compute[75993]:       <nova:ports>
Nov 08 21:47:53 user nova-compute[75993]:         <nova:port uuid="6e1733d1-86b8-4b78-b2a1-830ac109f583">
Nov 08 21:47:53 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 21:47:53 user nova-compute[75993]:         </nova:port>
Nov 08 21:47:53 user nova-compute[75993]:       </nova:ports>
Nov 08 21:47:53 user nova-compute[75993]:     </nova:instance>
Nov 08 21:47:53 user nova-compute[75993]:   </metadata>
Nov 08 21:47:53 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:47:53 user nova-compute[75993]:     <system>
Nov 08 21:47:53 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:47:53 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:47:53 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:47:53 user nova-compute[75993]:       <entry name="serial">64d8c15c-0ac9-434b-852a-123a940dc0ae</entry>
Nov 08 21:47:53 user nova-compute[75993]:       <entry name="uuid">64d8c15c-0ac9-434b-852a-123a940dc0ae</entry>
Nov 08 21:47:53 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:47:53 user nova-compute[75993]:     </system>
Nov 08 21:47:53 user nova-compute[75993]:   </sysinfo>
Nov 08 21:47:53 user nova-compute[75993]:   <os>
Nov 08 21:47:53 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:47:53 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:47:53 user nova-compute[75993]:   </os>
Nov 08 21:47:53 user nova-compute[75993]:   <features>
Nov 08 21:47:53 user nova-compute[75993]:     <acpi/>
Nov 08 21:47:53 user nova-compute[75993]:     <apic/>
Nov 08 21:47:53 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:47:53 user nova-compute[75993]:   </features>
Nov 08 21:47:53 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:47:53 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:47:53 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:47:53 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:47:53 user nova-compute[75993]:   </clock>
Nov 08 21:47:53 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:47:53 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:47:53 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:47:53 user nova-compute[75993]:   </cpu>
Nov 08 21:47:53 user nova-compute[75993]:   <devices>
Nov 08 21:47:53 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:47:53 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:47:53 user nova-compute[75993]:       <source dev="/dev/sdd"/>
Nov 08 21:47:53 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:47:53 user nova-compute[75993]:       <serial>567f6f9e-3314-4f87-853f-7786f54a9ab3</serial>
Nov 08 21:47:53 user nova-compute[75993]:     </disk>
Nov 08 21:47:53 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:47:53 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:47:53 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.rescue"/>
Nov 08 21:47:53 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:47:53 user nova-compute[75993]:       <boot order="1"/>
Nov 08 21:47:53 user nova-compute[75993]:     </disk>
Nov 08 21:47:53 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:47:53 user nova-compute[75993]:       <mac address="fa:16:3e:5e:6e:60"/>
Nov 08 21:47:53 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:47:53 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:47:53 user nova-compute[75993]:       <target dev="tap6e1733d1-86"/>
Nov 08 21:47:53 user nova-compute[75993]:     </interface>
Nov 08 21:47:53 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:47:53 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/console.log" append="off"/>
Nov 08 21:47:53 user nova-compute[75993]:     </serial>
Nov 08 21:47:53 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:47:53 user nova-compute[75993]:     <video>
Nov 08 21:47:53 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:47:53 user nova-compute[75993]:     </video>
Nov 08 21:47:53 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:47:53 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:47:53 user nova-compute[75993]:     </rng>
Nov 08 21:47:53 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:47:53 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:47:53 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:47:53 user nova-compute[75993]:     </memballoon>
Nov 08 21:47:53 user nova-compute[75993]:   </devices>
Nov 08 21:47:53 user nova-compute[75993]: </domain>
Nov 08 21:47:53 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:47:53 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Instance destroyed successfully.
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:47:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No VIF found with MAC fa:16:3e:5e:6e:60, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:47:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:47:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:47:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] No VIF found with MAC fa:16:3e:4d:61:3f, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:47:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f11a52f2-1502-4ca7-84ab-4dde42e2942a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.577s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG nova.compute.manager [req-b6376c38-b507-4648-990f-a9848afa336d req-a5589320-0d4d-4de2-8ecc-d69058067385 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b6376c38-b507-4648-990f-a9848afa336d req-a5589320-0d4d-4de2-8ecc-d69058067385 service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b6376c38-b507-4648-990f-a9848afa336d req-a5589320-0d4d-4de2-8ecc-d69058067385 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b6376c38-b507-4648-990f-a9848afa336d req-a5589320-0d4d-4de2-8ecc-d69058067385 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG nova.compute.manager [req-b6376c38-b507-4648-990f-a9848afa336d req-a5589320-0d4d-4de2-8ecc-d69058067385 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:55 user nova-compute[75993]: WARNING nova.compute.manager [req-b6376c38-b507-4648-990f-a9848afa336d req-a5589320-0d4d-4de2-8ecc-d69058067385 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received unexpected event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with vm_state resized and task_state resize_reverting.
Nov 08 21:47:55 user nova-compute[75993]: DEBUG nova.compute.manager [req-2b29eb27-04fc-4e0b-8125-17aaa9feb34d req-7e8fd6c7-466f-4b73-8bc3-b2fd4b81fb9f service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2b29eb27-04fc-4e0b-8125-17aaa9feb34d req-7e8fd6c7-466f-4b73-8bc3-b2fd4b81fb9f service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2b29eb27-04fc-4e0b-8125-17aaa9feb34d req-7e8fd6c7-466f-4b73-8bc3-b2fd4b81fb9f service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2b29eb27-04fc-4e0b-8125-17aaa9feb34d req-7e8fd6c7-466f-4b73-8bc3-b2fd4b81fb9f service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:55 user nova-compute[75993]: DEBUG nova.compute.manager [req-2b29eb27-04fc-4e0b-8125-17aaa9feb34d req-7e8fd6c7-466f-4b73-8bc3-b2fd4b81fb9f service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:55 user nova-compute[75993]: WARNING nova.compute.manager [req-2b29eb27-04fc-4e0b-8125-17aaa9feb34d req-7e8fd6c7-466f-4b73-8bc3-b2fd4b81fb9f service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received unexpected event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with vm_state active and task_state rescuing.
Nov 08 21:47:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:47:57 user nova-compute[75993]: DEBUG nova.compute.manager [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:47:57 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance running successfully.
Nov 08 21:47:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] finish_revert_migration finished successfully. {{(pid=75993) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 08 21:47:57 user nova-compute[75993]: INFO nova.compute.manager [None req-cfc7ed70-4cb2-4df2-ab9b-8a1c386531f2 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance to original state: 'active'
Nov 08 21:47:57 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:47:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-8ac55d60-e7fa-4df4-858c-7d659deedcd7 req-4e7185e5-f6c2-4531-a692-fcdf956b0b5d service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:47:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8ac55d60-e7fa-4df4-858c-7d659deedcd7 req-4e7185e5-f6c2-4531-a692-fcdf956b0b5d service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8ac55d60-e7fa-4df4-858c-7d659deedcd7 req-4e7185e5-f6c2-4531-a692-fcdf956b0b5d service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:47:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8ac55d60-e7fa-4df4-858c-7d659deedcd7 req-4e7185e5-f6c2-4531-a692-fcdf956b0b5d service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:47:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-8ac55d60-e7fa-4df4-858c-7d659deedcd7 req-4e7185e5-f6c2-4531-a692-fcdf956b0b5d service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:47:57 user nova-compute[75993]: WARNING nova.compute.manager [req-8ac55d60-e7fa-4df4-858c-7d659deedcd7 req-4e7185e5-f6c2-4531-a692-fcdf956b0b5d service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received unexpected event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with vm_state active and task_state rescuing.
Nov 08 21:47:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-539013f8-d3e2-40ae-b09f-8b6ca2c64e47 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:47:59 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:47:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:47:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:47:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:47:59 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:47:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:47:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG nova.objects.instance [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lazy-loading 'flavor' on Instance uuid cd48056d-13f0-4d8e-839e-0bd392c60478 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:00 user nova-compute[75993]: INFO nova.compute.manager [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Attaching volume 9acda2c8-644f-4806-8829-2bca555ec5b1 to /dev/vdc
Nov 08 21:48:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Updating instance_info_cache with network_info: [{"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-e7d6503c-765f-4652-8865-e6494e6f58d2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG os_brick.utils [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92abb90-e79a-447f-89ed-81281c4aaed2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7758455e-0d5d-4151-b5f8-a40de489750e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4755c2-4f9d-48aa-901b-bd262a28a007]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541d4e3-1ae1-4b9d-9e55-f906019f5f67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:48:00 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edfaf4c-e1fe-4200-a69b-f5d02a11229f]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG os_brick.utils [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Updating existing volume attachment record: 5249bb18-a37f-4331-a494-5e5437b85c19 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:02 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:48:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk.rescue --force-share --output=json" returned: 0 in 0.243s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:03 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:48:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:48:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:07 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:48:07 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:48:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7096MB free_disk=24.89240264892578GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:48:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance cd48056d-13f0-4d8e-839e-0bd392c60478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance a3c86d97-9bc3-45a0-98da-9dbc56890b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance ac5baff9-c777-47fe-b799-a075870d897a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f047433f-eaaa-4b81-b97c-6aa2f1cecff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:48:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:48:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:48:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "ac5baff9-c777-47fe-b799-a075870d897a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "ac5baff9-c777-47fe-b799-a075870d897a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "ac5baff9-c777-47fe-b799-a075870d897a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "ac5baff9-c777-47fe-b799-a075870d897a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "ac5baff9-c777-47fe-b799-a075870d897a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:21 user nova-compute[75993]: INFO nova.compute.manager [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Terminating instance
Nov 08 21:48:21 user nova-compute[75993]: DEBUG nova.compute.manager [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:48:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-e202d327-9f53-4d6d-bbed-06fdf65ca988 req-a3bd386c-0aa4-4ef0-82af-a5098ca5503b service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Received event network-vif-unplugged-504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e202d327-9f53-4d6d-bbed-06fdf65ca988 req-a3bd386c-0aa4-4ef0-82af-a5098ca5503b service nova] Acquiring lock "ac5baff9-c777-47fe-b799-a075870d897a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e202d327-9f53-4d6d-bbed-06fdf65ca988 req-a3bd386c-0aa4-4ef0-82af-a5098ca5503b service nova] Lock "ac5baff9-c777-47fe-b799-a075870d897a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e202d327-9f53-4d6d-bbed-06fdf65ca988 req-a3bd386c-0aa4-4ef0-82af-a5098ca5503b service nova] Lock "ac5baff9-c777-47fe-b799-a075870d897a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-e202d327-9f53-4d6d-bbed-06fdf65ca988 req-a3bd386c-0aa4-4ef0-82af-a5098ca5503b service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] No waiting events found dispatching network-vif-unplugged-504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-e202d327-9f53-4d6d-bbed-06fdf65ca988 req-a3bd386c-0aa4-4ef0-82af-a5098ca5503b service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Received event network-vif-unplugged-504c5857-26af-46bc-8c79-cc75f3901877 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:48:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Instance destroyed successfully.
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.objects.instance [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lazy-loading 'resources' on Instance uuid ac5baff9-c777-47fe-b799-a075870d897a {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:46:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1578367880',display_name='tempest-VolumesActionsTest-instance-1578367880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1578367880',id=26,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:46:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93a324eff68a4f3ebbf73ca83664e50b',ramdisk_id='',reservation_id='r-0n0aisao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1465914463',owner_user_name='tempest-VolumesActionsTest-1465914463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:46:39Z,user_data=None,user_id='f7ce4dd5fa2e4dbfbc817e77249680c7',uuid=ac5baff9-c777-47fe-b799-a075870d897a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "504c5857-26af-46bc-8c79-cc75f3901877", "address": "fa:16:3e:82:f6:91", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504c5857-26", "ovs_interfaceid": "504c5857-26af-46bc-8c79-cc75f3901877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converting VIF {"id": "504c5857-26af-46bc-8c79-cc75f3901877", "address": "fa:16:3e:82:f6:91", "network": {"id": "13148fab-1d7c-480a-88b0-fe3b9532c481", "bridge": "br-int", "label": "tempest-VolumesActionsTest-133428162-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a324eff68a4f3ebbf73ca83664e50b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap504c5857-26", "ovs_interfaceid": "504c5857-26af-46bc-8c79-cc75f3901877", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:f6:91,bridge_name='br-int',has_traffic_filtering=True,id=504c5857-26af-46bc-8c79-cc75f3901877,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504c5857-26') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG os_vif [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f6:91,bridge_name='br-int',has_traffic_filtering=True,id=504c5857-26af-46bc-8c79-cc75f3901877,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504c5857-26') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap504c5857-26, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f24a7473-deb2-4930-8d8e-32b57db96351) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:22 user nova-compute[75993]: INFO os_vif [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:f6:91,bridge_name='br-int',has_traffic_filtering=True,id=504c5857-26af-46bc-8c79-cc75f3901877,network=Network(13148fab-1d7c-480a-88b0-fe3b9532c481),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap504c5857-26')
Nov 08 21:48:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Deleting instance files /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a_del
Nov 08 21:48:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Deletion of /opt/stack/data/nova/instances/ac5baff9-c777-47fe-b799-a075870d897a_del complete
Nov 08 21:48:22 user nova-compute[75993]: INFO nova.compute.manager [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 08 21:48:22 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: ac5baff9-c777-47fe-b799-a075870d897a] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-0834a109-e287-4a31-bc67-a820777817c5 req-a8b8d8ea-4ba5-491b-b3e4-04e09626d655 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-changed-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-0834a109-e287-4a31-bc67-a820777817c5 req-a8b8d8ea-4ba5-491b-b3e4-04e09626d655 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Refreshing instance network info cache due to event network-changed-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0834a109-e287-4a31-bc67-a820777817c5 req-a8b8d8ea-4ba5-491b-b3e4-04e09626d655 service nova] Acquiring lock "refresh_cache-f047433f-eaaa-4b81-b97c-6aa2f1cecff0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0834a109-e287-4a31-bc67-a820777817c5 req-a8b8d8ea-4ba5-491b-b3e4-04e09626d655 service nova] Acquired lock "refresh_cache-f047433f-eaaa-4b81-b97c-6aa2f1cecff0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:48:22 user nova-compute[75993]: DEBUG nova.network.neutron [req-0834a109-e287-4a31-bc67-a820777817c5 req-a8b8d8ea-4ba5-491b-b3e4-04e09626d655 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Refreshing network info cache for port 6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:48:23 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:48:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-c3d0883e-56d4-41dd-900c-2e808d49cbe1 req-3d553815-ea19-4f74-8601-38ec05ad668b service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Received event network-vif-deleted-504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:48:23 user nova-compute[75993]: INFO nova.compute.manager [req-c3d0883e-56d4-41dd-900c-2e808d49cbe1 req-3d553815-ea19-4f74-8601-38ec05ad668b service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Neutron deleted interface 504c5857-26af-46bc-8c79-cc75f3901877; detaching it from the instance and deleting it from the info cache
Nov 08 21:48:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-c3d0883e-56d4-41dd-900c-2e808d49cbe1 req-3d553815-ea19-4f74-8601-38ec05ad668b service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:48:23 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Took 0.70 seconds to deallocate network for instance.
Nov 08 21:48:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-c3d0883e-56d4-41dd-900c-2e808d49cbe1 req-3d553815-ea19-4f74-8601-38ec05ad668b service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Detach interface failed, port_id=504c5857-26af-46bc-8c79-cc75f3901877, reason: Instance ac5baff9-c777-47fe-b799-a075870d897a could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:48:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-0834a109-e287-4a31-bc67-a820777817c5 req-a8b8d8ea-4ba5-491b-b3e4-04e09626d655 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Updated VIF entry in instance network info cache for port 6cc7f32b-9074-4af0-a9c8-6a8a85fe166b. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:48:23 user nova-compute[75993]: DEBUG nova.network.neutron [req-0834a109-e287-4a31-bc67-a820777817c5 req-a8b8d8ea-4ba5-491b-b3e4-04e09626d655 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Updating instance_info_cache with network_info: [{"id": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "address": "fa:16:3e:b1:ee:3f", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc7f32b-90", "ovs_interfaceid": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:48:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0834a109-e287-4a31-bc67-a820777817c5 req-a8b8d8ea-4ba5-491b-b3e4-04e09626d655 service nova] Releasing lock "refresh_cache-f047433f-eaaa-4b81-b97c-6aa2f1cecff0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:48:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:23 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:48:23 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:48:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:23 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Deleted allocations for instance ac5baff9-c777-47fe-b799-a075870d897a
Nov 08 21:48:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eba72749-b573-48d4-9a80-f476db6a66a1 tempest-VolumesActionsTest-1465914463 tempest-VolumesActionsTest-1465914463-project-member] Lock "ac5baff9-c777-47fe-b799-a075870d897a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.195s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-962fac70-7971-4a88-8452-0c0fffe9101e req-be8bb5a8-a64c-4375-b507-85980047669c service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Received event network-vif-plugged-504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:48:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-962fac70-7971-4a88-8452-0c0fffe9101e req-be8bb5a8-a64c-4375-b507-85980047669c service nova] Acquiring lock "ac5baff9-c777-47fe-b799-a075870d897a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-962fac70-7971-4a88-8452-0c0fffe9101e req-be8bb5a8-a64c-4375-b507-85980047669c service nova] Lock "ac5baff9-c777-47fe-b799-a075870d897a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-962fac70-7971-4a88-8452-0c0fffe9101e req-be8bb5a8-a64c-4375-b507-85980047669c service nova] Lock "ac5baff9-c777-47fe-b799-a075870d897a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-962fac70-7971-4a88-8452-0c0fffe9101e req-be8bb5a8-a64c-4375-b507-85980047669c service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] No waiting events found dispatching network-vif-plugged-504c5857-26af-46bc-8c79-cc75f3901877 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:48:24 user nova-compute[75993]: WARNING nova.compute.manager [req-962fac70-7971-4a88-8452-0c0fffe9101e req-be8bb5a8-a64c-4375-b507-85980047669c service nova] [instance: ac5baff9-c777-47fe-b799-a075870d897a] Received unexpected event network-vif-plugged-504c5857-26af-46bc-8c79-cc75f3901877 for instance with vm_state deleted and task_state None.
Nov 08 21:48:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAWeQuLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:48:27 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:48:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:48:27 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:48:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:48:27 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eef646a-be0f-4d02-9809-baf4ee93cf67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:48:27 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[42980ccb-8e54-4fdc-9d8a-ff78bd5ce206]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1] added
Nov 08 21:48:27 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce416658-2044-417c-bc99-35bda596e77e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f3bf48-67bf-4833-b036-f3ae04c48d67]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PAWeQuLn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PAWeQuLn" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91aa749-e539-4cd5-a69d-4f392738bdb6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PAWeQuLn'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25d1f16-4a6e-46e3-a52e-e965cf98e7b8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb9ece7-3342-4995-8d37-1645a30eba3d]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:48:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:48:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0de1529-29cd-4479-bf03-e17f45452f05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1, portal: 172.16.0.220,3260]
Nov 08 21:48:28 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1, portal: 172.16.0.220,3260] successful.
Nov 08 21:48:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5dbfdb-8cd4-468f-91a5-61de63b280bd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9e5ddb-ce66-4a67-bea7-4e2603b68495]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:48:28 user nova-compute[75993]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 (non-flash)
Nov 08 21:48:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] HCTL ('39', '-', '-', 0) found on session 31 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5490b98a-f212-44e7-ae07-e78fbd3c31c1]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Searching for a device in session 31 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:48:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAWeQuLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '26563383162323866', 'path': '/dev/sdh'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563383162323866', 'path': '/dev/sdh'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG nova.objects.instance [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lazy-loading 'flavor' on Instance uuid cd48056d-13f0-4d8e-839e-0bd392c60478 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:48:29 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:48:29 user nova-compute[75993]:   <source dev="/dev/sdh"/>
Nov 08 21:48:29 user nova-compute[75993]:   <target dev="vdc" bus="virtio"/>
Nov 08 21:48:29 user nova-compute[75993]:   <serial>9acda2c8-644f-4806-8829-2bca555ec5b1</serial>
Nov 08 21:48:29 user nova-compute[75993]: </disk>
Nov 08 21:48:29 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] No VIF found with MAC fa:16:3e:4d:61:3f, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-338fef54-2e55-4ba6-8c5a-19b9e902da7d tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.639s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:29 user nova-compute[75993]: DEBUG nova.objects.instance [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'flavor' on Instance uuid f047433f-eaaa-4b81-b97c-6aa2f1cecff0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:30 user nova-compute[75993]: INFO nova.compute.manager [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Attaching volume acd65bfb-8aa3-4aeb-8883-6856e7c7361d to /dev/vdb
Nov 08 21:48:30 user nova-compute[75993]: DEBUG os_brick.utils [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7030153-e59c-4656-8921-9e2aa8d79c0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[604e8a0c-9eb2-457b-9ab8-16cbf3536997]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[56541e8e-71b9-4517-b1cf-099e682bbe8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cabff3-dbb4-4333-8c73-e25727b40c71]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:48:30 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:48:30 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e96f7f-9d22-4b72-88fa-46e650e6fed3]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG os_brick.utils [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:48:30 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Updating existing volume attachment record: 00284b3d-8b38-432e-affd-6a9ece7d08d2 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:48:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:31 user nova-compute[75993]: INFO nova.compute.manager [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Detaching volume 9acda2c8-644f-4806-8829-2bca555ec5b1
Nov 08 21:48:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:31 user nova-compute[75993]: INFO nova.virt.block_device [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Attempting to driver detach volume 9acda2c8-644f-4806-8829-2bca555ec5b1 from mountpoint /dev/vdc
Nov 08 21:48:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Attempting to detach device vdc from instance cd48056d-13f0-4d8e-839e-0bd392c60478 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:48:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:48:31 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:48:31 user nova-compute[75993]:   <source dev="/dev/sdh"/>
Nov 08 21:48:31 user nova-compute[75993]:   <target dev="vdc" bus="virtio"/>
Nov 08 21:48:31 user nova-compute[75993]:   <serial>9acda2c8-644f-4806-8829-2bca555ec5b1</serial>
Nov 08 21:48:31 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 21:48:31 user nova-compute[75993]: </disk>
Nov 08 21:48:31 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:48:31 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Successfully detached device vdc from instance cd48056d-13f0-4d8e-839e-0bd392c60478 from the persistent domain config.
Nov 08 21:48:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance cd48056d-13f0-4d8e-839e-0bd392c60478 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:48:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:48:31 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:48:31 user nova-compute[75993]:   <source dev="/dev/sdh"/>
Nov 08 21:48:31 user nova-compute[75993]:   <target dev="vdc" bus="virtio"/>
Nov 08 21:48:31 user nova-compute[75993]:   <serial>9acda2c8-644f-4806-8829-2bca555ec5b1</serial>
Nov 08 21:48:31 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 08 21:48:31 user nova-compute[75993]: </disk>
Nov 08 21:48:31 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:48:31 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance cd48056d-13f0-4d8e-839e-0bd392c60478 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-ce4d870e-25bd-4bb0-aab6-f5d595ae41db req-c9c9e5d3-ecb7-41da-93cb-4c95810d146a service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-changed-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-ce4d870e-25bd-4bb0-aab6-f5d595ae41db req-c9c9e5d3-ecb7-41da-93cb-4c95810d146a service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Refreshing instance network info cache due to event network-changed-89871e15-aec8-4d15-8672-313d84c98870. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ce4d870e-25bd-4bb0-aab6-f5d595ae41db req-c9c9e5d3-ecb7-41da-93cb-4c95810d146a service nova] Acquiring lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ce4d870e-25bd-4bb0-aab6-f5d595ae41db req-c9c9e5d3-ecb7-41da-93cb-4c95810d146a service nova] Acquired lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG nova.network.neutron [req-ce4d870e-25bd-4bb0-aab6-f5d595ae41db req-c9c9e5d3-ecb7-41da-93cb-4c95810d146a service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Refreshing network info cache for port 89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG nova.network.neutron [req-ce4d870e-25bd-4bb0-aab6-f5d595ae41db req-c9c9e5d3-ecb7-41da-93cb-4c95810d146a service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Updated VIF entry in instance network info cache for port 89871e15-aec8-4d15-8672-313d84c98870. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG nova.network.neutron [req-ce4d870e-25bd-4bb0-aab6-f5d595ae41db req-c9c9e5d3-ecb7-41da-93cb-4c95810d146a service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Updating instance_info_cache with network_info: [{"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ce4d870e-25bd-4bb0-aab6-f5d595ae41db req-c9c9e5d3-ecb7-41da-93cb-4c95810d146a service nova] Releasing lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'flavor' on Instance uuid f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:48:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:33 user nova-compute[75993]: INFO nova.compute.manager [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Attaching volume cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee to /dev/vdb
Nov 08 21:48:33 user nova-compute[75993]: DEBUG os_brick.utils [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c719a0e6-4ddc-42ce-87c6-a8a81c2ed6ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[20368f36-3697-400c-80c6-702a4df94a32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6304acc8-a73a-4a28-9cde-3563b033b57b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[97689645-9235-4bc2-9ef9-714ed831a61a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:48:33 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:48:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[32268046-a71c-4235-9489-31353ea807cf]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG os_brick.utils [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:48:33 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Updating existing volume attachment record: 6b31b9c0-0129-4fd1-8549-1285fbfd5cdb {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:48:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:51 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance cd48056d-13f0-4d8e-839e-0bd392c60478 is timed out.
Nov 08 21:48:51 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Successfully detached device vdc from instance cd48056d-13f0-4d8e-839e-0bd392c60478 from the live domain config.
Nov 08 21:48:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PAWeQuLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:48:51 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b24e4b-b25e-4b79-bd38-fc186df3874f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:48:51 user nova-compute[75993]: No targets found.
Nov 08 21:48:51 user nova-compute[75993]: iSNS:
Nov 08 21:48:51 user nova-compute[75993]: No targets found.
Nov 08 21:48:51 user nova-compute[75993]: STATIC:
Nov 08 21:48:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1
Nov 08 21:48:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:48:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:48:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:48:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:48:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:48:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7
Nov 08 21:48:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:48:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:48:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde
Nov 08 21:48:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:48:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:48:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0
Nov 08 21:48:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:48:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:48:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c
Nov 08 21:48:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:48:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:48:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526
Nov 08 21:48:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:48:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:48:51 user nova-compute[75993]: FIRMWARE:
Nov 08 21:48:51 user nova-compute[75993]: No targets found.
Nov 08 21:48:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:48:51 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:48:51 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f649970-23e3-46f7-a7d7-c03d29187826]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[afee088f-c53b-439a-86f5-432dc20b9117]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 (non-flash)
Nov 08 21:48:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:48:51 user nova-compute[75993]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 (non-flash)
Nov 08 21:48:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544f91480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1'): ({'sdh'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Removing single pathed devices sdh {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c33a31e-d0b6-4736-9e2c-c2555d46eb7c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[88184359-39b9-4109-b1d1-06462f1b7ac2]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Flushing IO for device /dev/sdh {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e382b61-d88e-4e2d-9273-17ea040aa7d3]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5fdfc0-a57c-4c8d-92f3-94591c30db1b]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] SCSI volumes sdh have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3282aed9-543b-4e29-9812-44cee002393b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[71df2ee9-f425-406f-b214-826d4a239e2e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1, portal: 172.16.0.220,3260]
Nov 08 21:48:52 user nova-compute[75993]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1, portal: 172.16.0.220,3260] successful.
Nov 08 21:48:52 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9acda2c8-644f-4806-8829-2bca555ec5b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b679598e-2a2b-476b-8c4c-056db973a4b1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:48:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] <== disconnect_volume: return (362ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:48:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:48:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:53 user nova-compute[75993]: DEBUG nova.objects.instance [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lazy-loading 'flavor' on Instance uuid cd48056d-13f0-4d8e-839e-0bd392c60478 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:48:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1e26e236-7ce7-40c5-b12f-5471a194a3e0 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.053s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.volume.cinder [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Update attachment failed for attachment 00284b3d-8b38-432e-affd-6a9ece7d08d2. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-38f4d121-b69a-4b80-91d2-7a9e1fbae3e5) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-38f4d121-b69a-4b80-91d2-7a9e1fbae3e5)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Failed to attach acd65bfb-8aa3-4aeb-8883-6856e7c7361d at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-38f4d121-b69a-4b80-91d2-7a9e1fbae3e5)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Traceback (most recent call last):
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     ret_val = method(obj, context, *args, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     self._do_attach(context, instance, volume, volume_api,
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     self._volume_attach(context, volume, connector, instance,
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     connection_info = volume_api.attachment_update(
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     res = method(self, ctx, *args, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     with excutils.save_and_reraise_exception():
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     self.force_reraise()
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     raise self.value
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     return method.func(obj, *args, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     resp = self._update('/attachments/%s' % id, body)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     return self.request(url, method, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0]     raise exceptions.from_response(resp, body)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-38f4d121-b69a-4b80-91d2-7a9e1fbae3e5)
Nov 08 21:48:53 user nova-compute[75993]: ERROR nova.compute.manager [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] 
Nov 08 21:48:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.245s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server [None req-03d16787-623d-4aed-87c6-7a7e822ce331 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-38f4d121-b69a-4b80-91d2-7a9e1fbae3e5)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-38f4d121-b69a-4b80-91d2-7a9e1fbae3e5)
Nov 08 21:48:53 user nova-compute[75993]: ERROR oslo_messaging.rpc.server 
Nov 08 21:48:53 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:48:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-62ccb4f5-df2b-4fc7-a587-26e389cb6aa0 req-7d00e311-5233-4d56-aa1b-677abdabfc2a service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-changed-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:48:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-62ccb4f5-df2b-4fc7-a587-26e389cb6aa0 req-7d00e311-5233-4d56-aa1b-677abdabfc2a service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Refreshing instance network info cache due to event network-changed-11175b03-1639-4225-a6ab-87b120bf2f3f. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:48:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-62ccb4f5-df2b-4fc7-a587-26e389cb6aa0 req-7d00e311-5233-4d56-aa1b-677abdabfc2a service nova] Acquiring lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:48:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-62ccb4f5-df2b-4fc7-a587-26e389cb6aa0 req-7d00e311-5233-4d56-aa1b-677abdabfc2a service nova] Acquired lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:48:56 user nova-compute[75993]: DEBUG nova.network.neutron [req-62ccb4f5-df2b-4fc7-a587-26e389cb6aa0 req-7d00e311-5233-4d56-aa1b-677abdabfc2a service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Refreshing network info cache for port 11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:48:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:48:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:48:57 user nova-compute[75993]: DEBUG nova.network.neutron [req-62ccb4f5-df2b-4fc7-a587-26e389cb6aa0 req-7d00e311-5233-4d56-aa1b-677abdabfc2a service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updated VIF entry in instance network info cache for port 11175b03-1639-4225-a6ab-87b120bf2f3f. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:48:57 user nova-compute[75993]: DEBUG nova.network.neutron [req-62ccb4f5-df2b-4fc7-a587-26e389cb6aa0 req-7d00e311-5233-4d56-aa1b-677abdabfc2a service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updating instance_info_cache with network_info: [{"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:48:57 user nova-compute[75993]: INFO nova.compute.manager [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Detaching volume 38977a6a-5b16-43d9-a128-c841537a50e7
Nov 08 21:48:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-62ccb4f5-df2b-4fc7-a587-26e389cb6aa0 req-7d00e311-5233-4d56-aa1b-677abdabfc2a service nova] Releasing lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:48:57 user nova-compute[75993]: INFO nova.virt.block_device [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Attempting to driver detach volume 38977a6a-5b16-43d9-a128-c841537a50e7 from mountpoint /dev/vdb
Nov 08 21:48:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Attempting to detach device vdb from instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:48:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:48:57 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:48:57 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:48:57 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:48:57 user nova-compute[75993]:   <serial>38977a6a-5b16-43d9-a128-c841537a50e7</serial>
Nov 08 21:48:57 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:48:57 user nova-compute[75993]: </disk>
Nov 08 21:48:57 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:48:57 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Successfully detached device vdb from instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 from the persistent domain config.
Nov 08 21:48:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:48:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:48:57 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:48:57 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:48:57 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:48:57 user nova-compute[75993]:   <serial>38977a6a-5b16-43d9-a128-c841537a50e7</serial>
Nov 08 21:48:57 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:48:57 user nova-compute[75993]: </disk>
Nov 08 21:48:57 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:48:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:48:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:48:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-a159ff0c-17aa-4e51-adda-17de4e0731b3 req-fdd63467-577f-4ff7-bf1c-b1adf54f95db service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-changed-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:48:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-a159ff0c-17aa-4e51-adda-17de4e0731b3 req-fdd63467-577f-4ff7-bf1c-b1adf54f95db service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Refreshing instance network info cache due to event network-changed-11175b03-1639-4225-a6ab-87b120bf2f3f. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:48:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a159ff0c-17aa-4e51-adda-17de4e0731b3 req-fdd63467-577f-4ff7-bf1c-b1adf54f95db service nova] Acquiring lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:48:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a159ff0c-17aa-4e51-adda-17de4e0731b3 req-fdd63467-577f-4ff7-bf1c-b1adf54f95db service nova] Acquired lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:48:58 user nova-compute[75993]: DEBUG nova.network.neutron [req-a159ff0c-17aa-4e51-adda-17de4e0731b3 req-fdd63467-577f-4ff7-bf1c-b1adf54f95db service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Refreshing network info cache for port 11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XenfiCxU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:48:59 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:48:59 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:48:59 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1331ba2-0a4e-42e9-b1b4-7f8988f361b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:48:59 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4585cad6-94bd-40e2-806e-240e686ab627]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee] added
Nov 08 21:48:59 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae855b38-3955-4a2d-93b4-99f7f03325b2]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5f14c9-ca57-4940-b65f-2f9539c32d68]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XenfiCxU {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:59 user nova-compute[75993]: INFO nova.compute.manager [None req-9ecab26a-1f64-4547-b663-c354d1a66b3f tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Unrescuing
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9ecab26a-1f64-4547-b663-c354d1a66b3f tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9ecab26a-1f64-4547-b663-c354d1a66b3f tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquired lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG nova.network.neutron [None req-9ecab26a-1f64-4547-b663-c354d1a66b3f tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XenfiCxU" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8284d3dd-5b1d-4b79-bbd5-06c4e970f664]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XenfiCxU'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ea56a8-57f6-4257-8c7b-d7492029b7d5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG nova.network.neutron [req-a159ff0c-17aa-4e51-adda-17de4e0731b3 req-fdd63467-577f-4ff7-bf1c-b1adf54f95db service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updated VIF entry in instance network info cache for port 11175b03-1639-4225-a6ab-87b120bf2f3f. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG nova.network.neutron [req-a159ff0c-17aa-4e51-adda-17de4e0731b3 req-fdd63467-577f-4ff7-bf1c-b1adf54f95db service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updating instance_info_cache with network_info: [{"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a159ff0c-17aa-4e51-adda-17de4e0731b3 req-fdd63467-577f-4ff7-bf1c-b1adf54f95db service nova] Releasing lock "refresh_cache-b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6397e4-591d-45e3-9ebf-7c8202d264ed]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:48:59 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:48:59 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d06d0d4-619e-4a0b-a127-ec9ce668a0be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260]
Nov 08 21:48:59 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260] successful.
Nov 08 21:48:59 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6889e65-40ff-4b80-b4d9-94e8e620c8bc]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aac5f72-0b93-4c36-8029-94be33b93c28]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)
Nov 08 21:48:59 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:48:59 user nova-compute[75993]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)
Nov 08 21:48:59 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] HCTL ('39', '-', '-', 0) found on session 32 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dafc82-6d65-4be3-9e62-5277c5e1f4cc]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching for a device in session 32 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XenfiCxU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG nova.network.neutron [None req-9ecab26a-1f64-4547-b663-c354d1a66b3f tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updating instance_info_cache with network_info: [{"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9ecab26a-1f64-4547-b663-c354d1a66b3f tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Releasing lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG nova.objects.instance [None req-9ecab26a-1f64-4547-b663-c354d1a66b3f tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'flavor' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:48:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23865346363643264', 'path': '/dev/sdh'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865346363643264', 'path': '/dev/sdh'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'flavor' on Instance uuid f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:49:00 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:49:00 user nova-compute[75993]:   <source dev="/dev/sdh"/>
Nov 08 21:49:00 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:49:00 user nova-compute[75993]:   <serial>cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee</serial>
Nov 08 21:49:00 user nova-compute[75993]: </disk>
Nov 08 21:49:00 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:49:00 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Instance destroyed successfully.
Nov 08 21:49:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-unplugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-unplugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:00 user nova-compute[75993]: WARNING nova.compute.manager [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received unexpected event network-vif-unplugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:00 user nova-compute[75993]: WARNING nova.compute.manager [req-613af73c-04dd-4dd2-a3c6-dc3b474dfa33 req-5f4d8d18-2015-42b8-b1e6-4aa292e5cede service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received unexpected event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:49:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No VIF found with MAC fa:16:3e:16:21:b5, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-6d610c23-3e5e-42b9-8efa-d64e98e7426f req-838ae7ff-ca18-4182-96a2-58dfa730d1e8 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-changed-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-6d610c23-3e5e-42b9-8efa-d64e98e7426f req-838ae7ff-ca18-4182-96a2-58dfa730d1e8 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Refreshing instance network info cache due to event network-changed-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6d610c23-3e5e-42b9-8efa-d64e98e7426f req-838ae7ff-ca18-4182-96a2-58dfa730d1e8 service nova] Acquiring lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6d610c23-3e5e-42b9-8efa-d64e98e7426f req-838ae7ff-ca18-4182-96a2-58dfa730d1e8 service nova] Acquired lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG nova.network.neutron [req-6d610c23-3e5e-42b9-8efa-d64e98e7426f req-838ae7ff-ca18-4182-96a2-58dfa730d1e8 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Refreshing network info cache for port 0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3819edb3-a840-4bd7-b975-e9ae16ec1158 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.129s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance_info_cache with network_info: [{"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-f828891c-fc9f-4d73-8467-2fa0a804ffb0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG nova.network.neutron [req-6d610c23-3e5e-42b9-8efa-d64e98e7426f req-838ae7ff-ca18-4182-96a2-58dfa730d1e8 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updated VIF entry in instance network info cache for port 0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG nova.network.neutron [req-6d610c23-3e5e-42b9-8efa-d64e98e7426f req-838ae7ff-ca18-4182-96a2-58dfa730d1e8 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updating instance_info_cache with network_info: [{"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:49:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6d610c23-3e5e-42b9-8efa-d64e98e7426f req-838ae7ff-ca18-4182-96a2-58dfa730d1e8 service nova] Releasing lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:49:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-8e22ca37-ad6a-484c-abe1-3492f51bf5b5 req-2f46aa28-aabd-4ab7-853a-b9a0938e294c service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8e22ca37-ad6a-484c-abe1-3492f51bf5b5 req-2f46aa28-aabd-4ab7-853a-b9a0938e294c service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8e22ca37-ad6a-484c-abe1-3492f51bf5b5 req-2f46aa28-aabd-4ab7-853a-b9a0938e294c service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8e22ca37-ad6a-484c-abe1-3492f51bf5b5 req-2f46aa28-aabd-4ab7-853a-b9a0938e294c service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-8e22ca37-ad6a-484c-abe1-3492f51bf5b5 req-2f46aa28-aabd-4ab7-853a-b9a0938e294c service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:02 user nova-compute[75993]: WARNING nova.compute.manager [req-8e22ca37-ad6a-484c-abe1-3492f51bf5b5 req-2f46aa28-aabd-4ab7-853a-b9a0938e294c service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received unexpected event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:49:03 user nova-compute[75993]: INFO nova.compute.manager [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Rebuilding instance
Nov 08 21:49:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG nova.compute.manager [req-ac14b2b1-13f9-4432-b7db-e0cdc1bb3919 req-3d7f3a37-38c7-425c-866c-635d5d124b4e service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-changed-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG nova.compute.manager [req-ac14b2b1-13f9-4432-b7db-e0cdc1bb3919 req-3d7f3a37-38c7-425c-866c-635d5d124b4e service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Refreshing instance network info cache due to event network-changed-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ac14b2b1-13f9-4432-b7db-e0cdc1bb3919 req-3d7f3a37-38c7-425c-866c-635d5d124b4e service nova] Acquiring lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ac14b2b1-13f9-4432-b7db-e0cdc1bb3919 req-3d7f3a37-38c7-425c-866c-635d5d124b4e service nova] Acquired lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG nova.network.neutron [req-ac14b2b1-13f9-4432-b7db-e0cdc1bb3919 req-3d7f3a37-38c7-425c-866c-635d5d124b4e service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Refreshing network info cache for port 0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG nova.compute.manager [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG nova.compute.manager [req-83c2f5fb-c1e8-4763-95b8-605ad8930d79 req-5e23e78b-dc6a-4b01-9e58-3e86602512a6 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-vif-unplugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-83c2f5fb-c1e8-4763-95b8-605ad8930d79 req-5e23e78b-dc6a-4b01-9e58-3e86602512a6 service nova] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-83c2f5fb-c1e8-4763-95b8-605ad8930d79 req-5e23e78b-dc6a-4b01-9e58-3e86602512a6 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-83c2f5fb-c1e8-4763-95b8-605ad8930d79 req-5e23e78b-dc6a-4b01-9e58-3e86602512a6 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:03 user nova-compute[75993]: DEBUG nova.compute.manager [req-83c2f5fb-c1e8-4763-95b8-605ad8930d79 req-5e23e78b-dc6a-4b01-9e58-3e86602512a6 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] No waiting events found dispatching network-vif-unplugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:03 user nova-compute[75993]: WARNING nova.compute.manager [req-83c2f5fb-c1e8-4763-95b8-605ad8930d79 req-5e23e78b-dc6a-4b01-9e58-3e86602512a6 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received unexpected event network-vif-unplugged-89871e15-aec8-4d15-8672-313d84c98870 for instance with vm_state active and task_state rebuilding.
Nov 08 21:49:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Instance destroyed successfully.
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG nova.network.neutron [req-ac14b2b1-13f9-4432-b7db-e0cdc1bb3919 req-3d7f3a37-38c7-425c-866c-635d5d124b4e service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updated VIF entry in instance network info cache for port 0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG nova.network.neutron [req-ac14b2b1-13f9-4432-b7db-e0cdc1bb3919 req-3d7f3a37-38c7-425c-866c-635d5d124b4e service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updating instance_info_cache with network_info: [{"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:49:04 user nova-compute[75993]: INFO nova.compute.manager [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Detaching volume cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ac14b2b1-13f9-4432-b7db-e0cdc1bb3919 req-3d7f3a37-38c7-425c-866c-635d5d124b4e service nova] Releasing lock "refresh_cache-7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:04 user nova-compute[75993]: INFO nova.virt.block_device [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Attempting to driver detach volume cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee from mountpoint /dev/vdb
Nov 08 21:49:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Attempting to detach device vdb from instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:49:04 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:49:04 user nova-compute[75993]:   <source dev="/dev/sdh"/>
Nov 08 21:49:04 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:49:04 user nova-compute[75993]:   <serial>cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee</serial>
Nov 08 21:49:04 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:49:04 user nova-compute[75993]: </disk>
Nov 08 21:49:04 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:49:04 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully detached device vdb from instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f from the persistent domain config.
Nov 08 21:49:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XenfiCxU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:49:04 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f75c261-eb94-4436-9653-0c84b6a4de2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:49:04 user nova-compute[75993]: No targets found.
Nov 08 21:49:04 user nova-compute[75993]: iSNS:
Nov 08 21:49:04 user nova-compute[75993]: No targets found.
Nov 08 21:49:04 user nova-compute[75993]: STATIC:
Nov 08 21:49:04 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:49:04 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:04 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:04 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7
Nov 08 21:49:04 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:04 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:04 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde
Nov 08 21:49:04 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:04 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:04 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0
Nov 08 21:49:04 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:04 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:04 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee
Nov 08 21:49:04 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:04 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:04 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c
Nov 08 21:49:04 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:04 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:04 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526
Nov 08 21:49:04 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:04 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:04 user nova-compute[75993]: FIRMWARE:
Nov 08 21:49:04 user nova-compute[75993]: No targets found.
Nov 08 21:49:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:49:04 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:49:04 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1119c8be-9674-4c1b-b4ac-f334a1812cf9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eb2dcd-db12-40c1-8b64-aa81bdc314c6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)
Nov 08 21:49:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:04 user nova-compute[75993]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)
Nov 08 21:49:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f856865b010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee'): ({'sdh'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Removing single pathed devices sdh {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb5fb58-c20e-4854-a3af-4b6c2dea0af6]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e18accb-31f7-443a-a234-afa1fa81686f]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flushing IO for device /dev/sdh {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ab12e3-5fda-4c4e-b5f0-ae9c0baf8bb0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd4281a-a9da-498b-8983-600fe1565a93]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] SCSI volumes sdh have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dab020-cb9a-4068-b45c-eedb0ad593ed]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[63283b87-6c17-493f-8865-d8192b69b9ec]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260]
Nov 08 21:49:04 user nova-compute[75993]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260] successful.
Nov 08 21:49:04 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64c31fe-f891-48d2-af24-6a72b6c98957]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== disconnect_volume: return (396ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9ecab26a-1f64-4547-b663-c354d1a66b3f tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG nova.compute.manager [req-703075e7-e137-4ab0-b603-11c426ee3d5a req-162b1fbd-73a1-4aa4-aa03-9e10a36e81b9 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-703075e7-e137-4ab0-b603-11c426ee3d5a req-162b1fbd-73a1-4aa4-aa03-9e10a36e81b9 service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-703075e7-e137-4ab0-b603-11c426ee3d5a req-162b1fbd-73a1-4aa4-aa03-9e10a36e81b9 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-703075e7-e137-4ab0-b603-11c426ee3d5a req-162b1fbd-73a1-4aa4-aa03-9e10a36e81b9 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG nova.compute.manager [req-703075e7-e137-4ab0-b603-11c426ee3d5a req-162b1fbd-73a1-4aa4-aa03-9e10a36e81b9 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:04 user nova-compute[75993]: WARNING nova.compute.manager [req-703075e7-e137-4ab0-b603-11c426ee3d5a req-162b1fbd-73a1-4aa4-aa03-9e10a36e81b9 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received unexpected event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with vm_state active and task_state None.
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:05 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Instance destroyed successfully.
Nov 08 21:49:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1222137561',display_name='tempest-ServerActionsTestOtherA-server-871506730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1222137561',id=28,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx16iEb6CeFHI0TasVxtYtLjeV3PPjbyaq7k//aB1Zq4ApiAjvF8kHWO6ru0wGEM9NttEZOQsBaV9WtV6vPGjv/2ZDyxWsE6IzcbI1GOMvT4gB4T5MAXhahrl24BHfVYQ==',key_name='tempest-keypair-1858342574',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:46:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-laco4f50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG os_vif [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89871e15-ae, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b9799cf9-77bc-43cc-8847-0fc7a79245c7) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:05 user nova-compute[75993]: INFO os_vif [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae')
Nov 08 21:49:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XenfiCxU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:49:05 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 21:49:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-d278c76f-b5a3-4513-9f95-da1a0544cf01 req-23b1a9dc-6734-418a-928c-1bcac9a5e7a7 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d278c76f-b5a3-4513-9f95-da1a0544cf01 req-23b1a9dc-6734-418a-928c-1bcac9a5e7a7 service nova] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d278c76f-b5a3-4513-9f95-da1a0544cf01 req-23b1a9dc-6734-418a-928c-1bcac9a5e7a7 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d278c76f-b5a3-4513-9f95-da1a0544cf01 req-23b1a9dc-6734-418a-928c-1bcac9a5e7a7 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-d278c76f-b5a3-4513-9f95-da1a0544cf01 req-23b1a9dc-6734-418a-928c-1bcac9a5e7a7 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] No waiting events found dispatching network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:05 user nova-compute[75993]: WARNING nova.compute.manager [req-d278c76f-b5a3-4513-9f95-da1a0544cf01 req-23b1a9dc-6734-418a-928c-1bcac9a5e7a7 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received unexpected event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 for instance with vm_state active and task_state rebuilding.
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9437ed9a-787b-4686-bd1e-0969489e3b2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:49:05 user nova-compute[75993]: No targets found.
Nov 08 21:49:05 user nova-compute[75993]: iSNS:
Nov 08 21:49:05 user nova-compute[75993]: No targets found.
Nov 08 21:49:05 user nova-compute[75993]: STATIC:
Nov 08 21:49:05 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:49:05 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:05 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:05 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7
Nov 08 21:49:05 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:05 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:05 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde
Nov 08 21:49:05 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:05 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:05 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0
Nov 08 21:49:05 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:05 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:05 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c
Nov 08 21:49:05 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:05 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:05 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526
Nov 08 21:49:05 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:05 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:05 user nova-compute[75993]: FIRMWARE:
Nov 08 21:49:05 user nova-compute[75993]: No targets found.
Nov 08 21:49:05 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:49:05 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:49:05 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6938b4b-ce3e-4df9-969a-8fccd49307af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c80203b-26f6-4d39-a354-0ac787d8043f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:49:06 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:06 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:06 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:49:06 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:06 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:49:06 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:06 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:06 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:49:06 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:06 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f85952bf6d0>, {}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Disconnecting from: [] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.081s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== disconnect_volume: return (84ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:49:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Deleting instance files /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f_del
Nov 08 21:49:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Deletion of /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f_del complete
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:06 user nova-compute[75993]: INFO nova.compute.manager [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Detaching volume 7c714742-3ee9-4c13-9343-b4490058e526
Nov 08 21:49:06 user nova-compute[75993]: INFO nova.virt.block_device [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Booting with volume cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee at /dev/vdb
Nov 08 21:49:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:06 user nova-compute[75993]: INFO nova.virt.block_device [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Attempting to driver detach volume 7c714742-3ee9-4c13-9343-b4490058e526 from mountpoint /dev/vdb
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.utils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Attempting to detach device vdb from instance a3c86d97-9bc3-45a0-98da-9dbc56890b78 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:49:06 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:49:06 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 21:49:06 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:49:06 user nova-compute[75993]:   <serial>7c714742-3ee9-4c13-9343-b4490058e526</serial>
Nov 08 21:49:06 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:49:06 user nova-compute[75993]: </disk>
Nov 08 21:49:06 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6f97f6-c11f-491d-96dd-82302d23ae85]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Successfully detached device vdb from instance a3c86d97-9bc3-45a0-98da-9dbc56890b78 from the persistent domain config.
Nov 08 21:49:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3c86d97-9bc3-45a0-98da-9dbc56890b78 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:49:06 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:49:06 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 21:49:06 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:49:06 user nova-compute[75993]:   <serial>7c714742-3ee9-4c13-9343-b4490058e526</serial>
Nov 08 21:49:06 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:49:06 user nova-compute[75993]: </disk>
Nov 08 21:49:06 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0ae297-b0d0-4ce9-9f83-1266399d89ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77f62e7-3a6d-4ee6-8b8f-62a8337f5f47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d91d687-9e83-4998-85a8-2f20e32fa70d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:49:06 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8616af-58fb-482b-9e4c-78b789b1fe7f]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG os_brick.utils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Updating existing volume attachment record: 4b0c680b-c9e5-4263-b867-0f46ad8d22b9 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3c86d97-9bc3-45a0-98da-9dbc56890b78 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:08 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Error from libvirt while getting description of instance-0000001c: [Error Code 42] Domain not found: no domain with matching uuid 'f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f' (instance-0000001c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f' (instance-0000001c)
Nov 08 21:49:08 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:49:08 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7303MB free_disk=24.90746307373047GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance cd48056d-13f0-4d8e-839e-0bd392c60478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance a3c86d97-9bc3-45a0-98da-9dbc56890b78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f047433f-eaaa-4b81-b97c-6aa2f1cecff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:49:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:49:09 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:49:09 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:49:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:49:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:49:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:49:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:49:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:49:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:49:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:17 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 is timed out.
Nov 08 21:49:17 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Successfully detached device vdb from instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 from the live domain config.
Nov 08 21:49:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fgbJswIA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:49:17 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:49:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a3b302-8c8c-4fc7-acaa-929ee1cde13b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:49:17 user nova-compute[75993]: No targets found.
Nov 08 21:49:17 user nova-compute[75993]: iSNS:
Nov 08 21:49:17 user nova-compute[75993]: No targets found.
Nov 08 21:49:17 user nova-compute[75993]: STATIC:
Nov 08 21:49:17 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:49:17 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:17 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:17 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7
Nov 08 21:49:17 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:17 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:17 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde
Nov 08 21:49:17 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:17 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:17 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0
Nov 08 21:49:17 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:17 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:17 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c
Nov 08 21:49:17 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:17 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:17 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526
Nov 08 21:49:17 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:17 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:17 user nova-compute[75993]: FIRMWARE:
Nov 08 21:49:17 user nova-compute[75993]: No targets found.
Nov 08 21:49:17 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:49:17 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:49:17 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e850b7-334d-4bd3-bbba-7313d2dc553a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41f0aaf-b2e2-4f90-97fb-2df33148ea4c]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:49:18 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:18 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:18 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:49:18 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:18 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:18 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 (non-flash)
Nov 08 21:49:18 user nova-compute[75993]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:18 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:18 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:49:18 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:18 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:18 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f858c379d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbab94b9-7b71-4285-aee8-6888c7b65147]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[992d0065-17ea-464f-bc15-255bf7cc3a63]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9558f6c7-baa3-4faa-9b4a-628bc67e0661]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.065s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2850146-268a-4a62-bb67-86d4a8bbdc9d]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7251e1d6-fc82-4ade-b865-f53d2478b946]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c3b438-a01d-4666-8441-92c5bb5805d5]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7, portal: 172.16.0.220,3260]
Nov 08 21:49:18 user nova-compute[75993]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7, portal: 172.16.0.220,3260] successful.
Nov 08 21:49:18 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38977a6a-5b16-43d9-a128-c841537a50e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5d54bb-8158-4777-9803-277810480dd4]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.524s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] <== disconnect_volume: return (525ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:49:18 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:49:19 user nova-compute[75993]: DEBUG nova.objects.instance [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'flavor' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:49:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55bb9970-00ed-4397-b64f-e2cd223a5a05 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.305s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:49:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:21 user nova-compute[75993]: INFO nova.compute.manager [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Detaching volume 4882f793-6849-460b-ae8c-958f62df6e9c
Nov 08 21:49:21 user nova-compute[75993]: INFO nova.virt.block_device [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Attempting to driver detach volume 4882f793-6849-460b-ae8c-958f62df6e9c from mountpoint /dev/vdb
Nov 08 21:49:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Attempting to detach device vdb from instance cd48056d-13f0-4d8e-839e-0bd392c60478 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:49:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:49:21 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:49:21 user nova-compute[75993]:   <source dev="/dev/sdg"/>
Nov 08 21:49:21 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:49:21 user nova-compute[75993]:   <serial>4882f793-6849-460b-ae8c-958f62df6e9c</serial>
Nov 08 21:49:21 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:49:21 user nova-compute[75993]: </disk>
Nov 08 21:49:21 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:49:21 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Successfully detached device vdb from instance cd48056d-13f0-4d8e-839e-0bd392c60478 from the persistent domain config.
Nov 08 21:49:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd48056d-13f0-4d8e-839e-0bd392c60478 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:49:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:49:21 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:49:21 user nova-compute[75993]:   <source dev="/dev/sdg"/>
Nov 08 21:49:21 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:49:21 user nova-compute[75993]:   <serial>4882f793-6849-460b-ae8c-958f62df6e9c</serial>
Nov 08 21:49:21 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:49:21 user nova-compute[75993]: </disk>
Nov 08 21:49:21 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:49:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd48056d-13f0-4d8e-839e-0bd392c60478 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:49:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:26 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a3c86d97-9bc3-45a0-98da-9dbc56890b78 is timed out.
Nov 08 21:49:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Successfully detached device vdb from instance a3c86d97-9bc3-45a0-98da-9dbc56890b78 from the live domain config.
Nov 08 21:49:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYsVoQeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:49:26 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e271c277-f509-4c9f-824f-920ddb49610a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:49:26 user nova-compute[75993]: No targets found.
Nov 08 21:49:26 user nova-compute[75993]: iSNS:
Nov 08 21:49:26 user nova-compute[75993]: No targets found.
Nov 08 21:49:26 user nova-compute[75993]: STATIC:
Nov 08 21:49:26 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:49:26 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:26 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:26 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde
Nov 08 21:49:26 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:26 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:26 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0
Nov 08 21:49:26 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:26 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:26 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c
Nov 08 21:49:26 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:26 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:26 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526
Nov 08 21:49:26 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:26 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:26 user nova-compute[75993]: FIRMWARE:
Nov 08 21:49:26 user nova-compute[75993]: No targets found.
Nov 08 21:49:26 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:49:26 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:49:26 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cf7ced-da72-42b8-980e-d8ab810f4dcd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a98ca23-7a53-46b4-b923-c73718cb8389]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:26 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:26 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:49:26 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:26 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:26 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:26 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:26 user nova-compute[75993]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 (non-flash)
Nov 08 21:49:26 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:26 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:26 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f85684f6b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e770b7-abb5-4f8b-b924-3b478e01cbda]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf1ba1b-43cf-4bc3-ab37-90763c799482]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62306f-eb68-47dc-b656-9c3027833243]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:49:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bd2469-480e-41ce-a6a3-ae32dd6c5c22]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c2d8c4-96a6-4851-a801-311b4fe7de93]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba3e7e2-797e-46fe-bd3b-9d5b70e27031]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526, portal: 172.16.0.220,3260]
Nov 08 21:49:27 user nova-compute[75993]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526, portal: 172.16.0.220,3260] successful.
Nov 08 21:49:27 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31c365a-f76d-4744-8e8a-499f45a88acd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] <== disconnect_volume: return (307ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:49:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG nova.objects.instance [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lazy-loading 'flavor' on Instance uuid a3c86d97-9bc3-45a0-98da-9dbc56890b78 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b668d8ce-f085-4f40-b0f3-45e8400ee3aa tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.013s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.799s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:28 user nova-compute[75993]: INFO nova.compute.manager [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Terminating instance
Nov 08 21:49:28 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-bb08a2d5-771e-4646-a1c8-59b8eaba8705 req-63910dcc-3b9f-4971-b4ec-22ab73f8b736 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Received event network-vif-unplugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bb08a2d5-771e-4646-a1c8-59b8eaba8705 req-63910dcc-3b9f-4971-b4ec-22ab73f8b736 service nova] Acquiring lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bb08a2d5-771e-4646-a1c8-59b8eaba8705 req-63910dcc-3b9f-4971-b4ec-22ab73f8b736 service nova] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bb08a2d5-771e-4646-a1c8-59b8eaba8705 req-63910dcc-3b9f-4971-b4ec-22ab73f8b736 service nova] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-bb08a2d5-771e-4646-a1c8-59b8eaba8705 req-63910dcc-3b9f-4971-b4ec-22ab73f8b736 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] No waiting events found dispatching network-vif-unplugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-bb08a2d5-771e-4646-a1c8-59b8eaba8705 req-63910dcc-3b9f-4971-b4ec-22ab73f8b736 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Received event network-vif-unplugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:49:28 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Instance destroyed successfully.
Nov 08 21:49:28 user nova-compute[75993]: DEBUG nova.objects.instance [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lazy-loading 'resources' on Instance uuid a3c86d97-9bc3-45a0-98da-9dbc56890b78 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:45:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-887136851',display_name='tempest-VolumesSnapshotTestJSON-instance-887136851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-887136851',id=24,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDV4/dAnxbBBHPIf3Wod47YKbLsXWlvsPWhg99Z6ymTCpBlJ7/z8R/H2L4aDToPy+PK3+C8dbEdpShdp08W4jYnN/rQN3Hu7Rn7A1tn/AbVtxIiGfGVva7JmifuNtmWCZQ==',key_name='tempest-keypair-585481416',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b942ec0575e4665a594614ccba455d3',ramdisk_id='',reservation_id='r-5wbgk0es',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1072091596',owner_user_name='tempest-VolumesSnapshotTestJSON-1072091596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:45:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b330b61ef9cd48bdacbb7a7a695f34cb',uuid=a3c86d97-9bc3-45a0-98da-9dbc56890b78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "address": "fa:16:3e:8c:43:91", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1990007-cd", "ovs_interfaceid": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converting VIF {"id": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "address": "fa:16:3e:8c:43:91", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1990007-cd", "ovs_interfaceid": "f1990007-cd9f-4690-a4ab-b9db8ff871e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:43:91,bridge_name='br-int',has_traffic_filtering=True,id=f1990007-cd9f-4690-a4ab-b9db8ff871e3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1990007-cd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_vif [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:43:91,bridge_name='br-int',has_traffic_filtering=True,id=f1990007-cd9f-4690-a4ab-b9db8ff871e3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1990007-cd') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1990007-cd, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4e0f469-7a97-4523-a299-15825147799e) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:28 user nova-compute[75993]: INFO os_vif [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:43:91,bridge_name='br-int',has_traffic_filtering=True,id=f1990007-cd9f-4690-a4ab-b9db8ff871e3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1990007-cd')
Nov 08 21:49:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYsVoQeS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:49:28 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e60ebe-34ce-4aed-ae08-09171fd7220a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:49:28 user nova-compute[75993]: No targets found.
Nov 08 21:49:28 user nova-compute[75993]: iSNS:
Nov 08 21:49:28 user nova-compute[75993]: No targets found.
Nov 08 21:49:28 user nova-compute[75993]: STATIC:
Nov 08 21:49:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:49:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde
Nov 08 21:49:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0
Nov 08 21:49:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:28 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c
Nov 08 21:49:28 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:28 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:28 user nova-compute[75993]: FIRMWARE:
Nov 08 21:49:28 user nova-compute[75993]: No targets found.
Nov 08 21:49:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:49:28 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:49:28 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c714742-3ee9-4c13-9343-b4490058e526', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[28782bc6-7d88-4ecb-a829-a45415837767]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[da626351-9b45-4364-b2e6-8cc41fb986a3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:28 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:28 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:28 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:28 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:28 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:28 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:28 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f858c37b370>, {}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Disconnecting from: [] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] <== disconnect_volume: return (72ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:49:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:49:28 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Deleting instance files /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78_del
Nov 08 21:49:29 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Deletion of /opt/stack/data/nova/instances/a3c86d97-9bc3-45a0-98da-9dbc56890b78_del complete
Nov 08 21:49:29 user nova-compute[75993]: INFO nova.compute.manager [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 08 21:49:29 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:49:29 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:49:29 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:49:29 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:49:29 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Took 0.77 seconds to deallocate network for instance.
Nov 08 21:49:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-f60576cb-7ac0-4988-ae4c-16decd280793 req-93be34e9-97d9-41d4-adc2-e5f529d0bb52 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Received event network-vif-deleted-f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:29 user nova-compute[75993]: WARNING nova.volume.cinder [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Attachment c9bd81c7-2b8d-48f0-b72b-b84f87a92781 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c9bd81c7-2b8d-48f0-b72b-b84f87a92781. (HTTP 404) (Request-ID: req-1c3f1dc3-3bc0-4ec9-870d-e7fd45cfa334)
Nov 08 21:49:29 user nova-compute[75993]: INFO nova.compute.manager [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Took 0.02 seconds to detach 1 volumes for instance.
Nov 08 21:49:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:30 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:49:30 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:49:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:30 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Deleted allocations for instance a3c86d97-9bc3-45a0-98da-9dbc56890b78
Nov 08 21:49:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-973f2e46-f57e-4a98-afa0-e6aca20cd677 req-01542852-ae7d-49bb-ad2a-fa61097c3c11 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Received event network-vif-plugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-973f2e46-f57e-4a98-afa0-e6aca20cd677 req-01542852-ae7d-49bb-ad2a-fa61097c3c11 service nova] Acquiring lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-973f2e46-f57e-4a98-afa0-e6aca20cd677 req-01542852-ae7d-49bb-ad2a-fa61097c3c11 service nova] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-973f2e46-f57e-4a98-afa0-e6aca20cd677 req-01542852-ae7d-49bb-ad2a-fa61097c3c11 service nova] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-973f2e46-f57e-4a98-afa0-e6aca20cd677 req-01542852-ae7d-49bb-ad2a-fa61097c3c11 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] No waiting events found dispatching network-vif-plugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:30 user nova-compute[75993]: WARNING nova.compute.manager [req-973f2e46-f57e-4a98-afa0-e6aca20cd677 req-01542852-ae7d-49bb-ad2a-fa61097c3c11 service nova] [instance: a3c86d97-9bc3-45a0-98da-9dbc56890b78] Received unexpected event network-vif-plugged-f1990007-cd9f-4690-a4ab-b9db8ff871e3 for instance with vm_state deleted and task_state None.
Nov 08 21:49:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d2cd4b4d-7c61-477e-abae-39ff7231a9dc tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "a3c86d97-9bc3-45a0-98da-9dbc56890b78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.506s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:33 user nova-compute[75993]: INFO nova.compute.manager [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Detaching volume db1c38e9-2000-4a04-8b9c-50c7207f6dde
Nov 08 21:49:33 user nova-compute[75993]: INFO nova.virt.block_device [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Attempting to driver detach volume db1c38e9-2000-4a04-8b9c-50c7207f6dde from mountpoint /dev/vdb
Nov 08 21:49:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Attempting to detach device vdb from instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:49:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:49:33 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:49:33 user nova-compute[75993]:   <source dev="/dev/sde"/>
Nov 08 21:49:33 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:49:33 user nova-compute[75993]:   <serial>db1c38e9-2000-4a04-8b9c-50c7207f6dde</serial>
Nov 08 21:49:33 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:49:33 user nova-compute[75993]: </disk>
Nov 08 21:49:33 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:49:33 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Successfully detached device vdb from instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 from the persistent domain config.
Nov 08 21:49:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:49:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:49:33 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:49:33 user nova-compute[75993]:   <source dev="/dev/sde"/>
Nov 08 21:49:33 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:49:33 user nova-compute[75993]:   <serial>db1c38e9-2000-4a04-8b9c-50c7207f6dde</serial>
Nov 08 21:49:33 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:49:33 user nova-compute[75993]: </disk>
Nov 08 21:49:33 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:49:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:49:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:40 user nova-compute[75993]: INFO nova.compute.manager [None req-294577cd-5fdf-4e1d-8120-8a8be4f21c38 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Unrescuing
Nov 08 21:49:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-294577cd-5fdf-4e1d-8120-8a8be4f21c38 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-294577cd-5fdf-4e1d-8120-8a8be4f21c38 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquired lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG nova.network.neutron [None req-294577cd-5fdf-4e1d-8120-8a8be4f21c38 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG nova.network.neutron [None req-294577cd-5fdf-4e1d-8120-8a8be4f21c38 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updating instance_info_cache with network_info: [{"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-294577cd-5fdf-4e1d-8120-8a8be4f21c38 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Releasing lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG nova.objects.instance [None req-294577cd-5fdf-4e1d-8120-8a8be4f21c38 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'flavor' on Instance uuid 64d8c15c-0ac9-434b-852a-123a940dc0ae {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-f71bb9e4-03f4-44d8-b644-dba60b4fce90 req-9ed59aaa-dbb0-4151-91ce-2d3fbba52bee service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-unplugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f71bb9e4-03f4-44d8-b644-dba60b4fce90 req-9ed59aaa-dbb0-4151-91ce-2d3fbba52bee service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f71bb9e4-03f4-44d8-b644-dba60b4fce90 req-9ed59aaa-dbb0-4151-91ce-2d3fbba52bee service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f71bb9e4-03f4-44d8-b644-dba60b4fce90 req-9ed59aaa-dbb0-4151-91ce-2d3fbba52bee service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-f71bb9e4-03f4-44d8-b644-dba60b4fce90 req-9ed59aaa-dbb0-4151-91ce-2d3fbba52bee service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-unplugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:40 user nova-compute[75993]: WARNING nova.compute.manager [req-f71bb9e4-03f4-44d8-b644-dba60b4fce90 req-9ed59aaa-dbb0-4151-91ce-2d3fbba52bee service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received unexpected event network-vif-unplugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:49:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Instance destroyed successfully.
Nov 08 21:49:42 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd48056d-13f0-4d8e-839e-0bd392c60478 is timed out.
Nov 08 21:49:42 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Successfully detached device vdb from instance cd48056d-13f0-4d8e-839e-0bd392c60478 from the live domain config.
Nov 08 21:49:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BhPbcVde', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:49:42 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c4fdd9-853b-4e11-8f0a-b2c7ef635725]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:49:42 user nova-compute[75993]: No targets found.
Nov 08 21:49:42 user nova-compute[75993]: iSNS:
Nov 08 21:49:42 user nova-compute[75993]: No targets found.
Nov 08 21:49:42 user nova-compute[75993]: STATIC:
Nov 08 21:49:42 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:49:42 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:42 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:42 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde
Nov 08 21:49:42 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:42 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:42 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0
Nov 08 21:49:42 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:42 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:42 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c
Nov 08 21:49:42 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:42 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:42 user nova-compute[75993]: FIRMWARE:
Nov 08 21:49:42 user nova-compute[75993]: No targets found.
Nov 08 21:49:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:49:42 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:49:42 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bade8130-f9a3-4df8-b817-711e1bd004a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7441342-65bb-4ea1-8623-7ba8eccbe57e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:42 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:42 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:42 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:42 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:42 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:42 user nova-compute[75993]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c (non-flash)
Nov 08 21:49:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544f32a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c'): ({'sdg'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Removing single pathed devices sdg {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[070bc621-767b-4e8e-84be-d514716f4315]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6bc4d0-60ce-4640-9b08-aeea6c111972]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Flushing IO for device /dev/sdg {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b151b023-3c53-4d71-9ce3-731d741b07e6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b1078f-02d3-4d0b-b0de-2efc1553ba8f]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] SCSI volumes sdg have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcab2882-31f8-4821-a9bb-6be2e40f62d6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1913c9d-23ef-4db9-b284-ce55ee209b6d]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c, portal: 172.16.0.220,3260]
Nov 08 21:49:42 user nova-compute[75993]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c, portal: 172.16.0.220,3260] successful.
Nov 08 21:49:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4882f793-6849-460b-ae8c-958f62df6e9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[21164acf-7ee1-4d24-abb3-ad332f20f357]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] <== disconnect_volume: return (337ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-eea85e55-2664-480c-aae2-6f014766a9ae req-ce4633ea-5bd1-4776-a008-a2c28093a231 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eea85e55-2664-480c-aae2-6f014766a9ae req-ce4633ea-5bd1-4776-a008-a2c28093a231 service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eea85e55-2664-480c-aae2-6f014766a9ae req-ce4633ea-5bd1-4776-a008-a2c28093a231 service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eea85e55-2664-480c-aae2-6f014766a9ae req-ce4633ea-5bd1-4776-a008-a2c28093a231 service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-eea85e55-2664-480c-aae2-6f014766a9ae req-ce4633ea-5bd1-4776-a008-a2c28093a231 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:43 user nova-compute[75993]: WARNING nova.compute.manager [req-eea85e55-2664-480c-aae2-6f014766a9ae req-ce4633ea-5bd1-4776-a008-a2c28093a231 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received unexpected event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:49:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:43 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lazy-loading 'flavor' on Instance uuid cd48056d-13f0-4d8e-839e-0bd392c60478 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:49:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ddf76504-08d9-416f-9921-83c48b2ffb6a tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.973s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-294577cd-5fdf-4e1d-8120-8a8be4f21c38 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:49:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:45 user nova-compute[75993]: WARNING nova.compute.manager [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received unexpected event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with vm_state active and task_state None.
Nov 08 21:49:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:45 user nova-compute[75993]: WARNING nova.compute.manager [req-c7579fe2-2a63-4d00-b775-65b4e9a6d1fd req-26974e4c-6eee-4ddc-a184-9c1b3c62ff1f service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received unexpected event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with vm_state active and task_state None.
Nov 08 21:49:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:47 user nova-compute[75993]: INFO nova.compute.manager [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Terminating instance
Nov 08 21:49:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:49:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-fc5df449-e761-4403-ab95-763fc1ec8b63 req-9ca7ab81-d066-49be-95ca-2142f9136b82 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-unplugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fc5df449-e761-4403-ab95-763fc1ec8b63 req-9ca7ab81-d066-49be-95ca-2142f9136b82 service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fc5df449-e761-4403-ab95-763fc1ec8b63 req-9ca7ab81-d066-49be-95ca-2142f9136b82 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fc5df449-e761-4403-ab95-763fc1ec8b63 req-9ca7ab81-d066-49be-95ca-2142f9136b82 service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-fc5df449-e761-4403-ab95-763fc1ec8b63 req-9ca7ab81-d066-49be-95ca-2142f9136b82 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-unplugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-fc5df449-e761-4403-ab95-763fc1ec8b63 req-9ca7ab81-d066-49be-95ca-2142f9136b82 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-unplugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Instance destroyed successfully.
Nov 08 21:49:48 user nova-compute[75993]: DEBUG nova.objects.instance [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'resources' on Instance uuid b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-744373370',display_name='tempest-ServerRescueNegativeTestJSON-server-744373370',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-744373370',id=19,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLfaG+VVz6j6R6G5t7bwcEHBVcu/+dmqNAghC60RUji3tflLGmrnWfYsNyzH+deEaQt/WI6desKUvCG3tX6Gf6/56vWX/mcwYnd9ukQpvl703osps4raWWMOwQOlTKfOew==',key_name='tempest-keypair-807516927',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:45:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-0qegnfbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:47:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37e02c3f49f1467498623a47a979a65d',uuid=b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "11175b03-1639-4225-a6ab-87b120bf2f3f", "address": "fa:16:3e:ba:f9:b5", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11175b03-16", "ovs_interfaceid": "11175b03-1639-4225-a6ab-87b120bf2f3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:f9:b5,bridge_name='br-int',has_traffic_filtering=True,id=11175b03-1639-4225-a6ab-87b120bf2f3f,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11175b03-16') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG os_vif [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:f9:b5,bridge_name='br-int',has_traffic_filtering=True,id=11175b03-1639-4225-a6ab-87b120bf2f3f,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11175b03-16') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11175b03-16, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d2b705b-d701-471c-b87f-fc8745713836) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:48 user nova-compute[75993]: INFO os_vif [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:f9:b5,bridge_name='br-int',has_traffic_filtering=True,id=11175b03-1639-4225-a6ab-87b120bf2f3f,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11175b03-16')
Nov 08 21:49:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Deleting instance files /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2_del
Nov 08 21:49:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Deletion of /opt/stack/data/nova/instances/b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2_del complete
Nov 08 21:49:48 user nova-compute[75993]: INFO nova.compute.manager [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 21:49:48 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:49:48 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:49:49 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:49:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-4e7f5cdd-9ea3-4330-a90a-e669911f214d req-916f29cd-8a17-486e-9da4-5c22c54854c1 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-deleted-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:49 user nova-compute[75993]: INFO nova.compute.manager [req-4e7f5cdd-9ea3-4330-a90a-e669911f214d req-916f29cd-8a17-486e-9da4-5c22c54854c1 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Neutron deleted interface 11175b03-1639-4225-a6ab-87b120bf2f3f; detaching it from the instance and deleting it from the info cache
Nov 08 21:49:49 user nova-compute[75993]: DEBUG nova.network.neutron [req-4e7f5cdd-9ea3-4330-a90a-e669911f214d req-916f29cd-8a17-486e-9da4-5c22c54854c1 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:49:49 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Took 1.01 seconds to deallocate network for instance.
Nov 08 21:49:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-4e7f5cdd-9ea3-4330-a90a-e669911f214d req-916f29cd-8a17-486e-9da4-5c22c54854c1 service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Detach interface failed, port_id=11175b03-1639-4225-a6ab-87b120bf2f3f, reason: Instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:49:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:50 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:49:50 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:49:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-36e94e04-6b6f-4bb7-ba33-35d4752c3eb7 req-2b6faf30-d951-4878-a13c-bf8b3c18c6ee service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-36e94e04-6b6f-4bb7-ba33-35d4752c3eb7 req-2b6faf30-d951-4878-a13c-bf8b3c18c6ee service nova] Acquiring lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-36e94e04-6b6f-4bb7-ba33-35d4752c3eb7 req-2b6faf30-d951-4878-a13c-bf8b3c18c6ee service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-36e94e04-6b6f-4bb7-ba33-35d4752c3eb7 req-2b6faf30-d951-4878-a13c-bf8b3c18c6ee service nova] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-36e94e04-6b6f-4bb7-ba33-35d4752c3eb7 req-2b6faf30-d951-4878-a13c-bf8b3c18c6ee service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] No waiting events found dispatching network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:50 user nova-compute[75993]: WARNING nova.compute.manager [req-36e94e04-6b6f-4bb7-ba33-35d4752c3eb7 req-2b6faf30-d951-4878-a13c-bf8b3c18c6ee service nova] [instance: b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2] Received unexpected event network-vif-plugged-11175b03-1639-4225-a6ab-87b120bf2f3f for instance with vm_state deleted and task_state None.
Nov 08 21:49:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:50 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Deleted allocations for instance b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2
Nov 08 21:49:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39b721fe-038a-4e2d-92c8-0981d9cb29bb tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "b2fb72a5-5491-48d6-a5c9-8ef79aaf4ca2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.476s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:53 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 is timed out.
Nov 08 21:49:53 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Successfully detached device vdb from instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 from the live domain config.
Nov 08 21:49:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHAZMJuG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:49:53 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1788471-3c3a-467a-b79c-ae8924722943]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:49:53 user nova-compute[75993]: No targets found.
Nov 08 21:49:53 user nova-compute[75993]: iSNS:
Nov 08 21:49:53 user nova-compute[75993]: No targets found.
Nov 08 21:49:53 user nova-compute[75993]: STATIC:
Nov 08 21:49:53 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:49:53 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:53 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:53 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde
Nov 08 21:49:53 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:53 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:53 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0
Nov 08 21:49:53 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:49:53 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:49:53 user nova-compute[75993]: FIRMWARE:
Nov 08 21:49:53 user nova-compute[75993]: No targets found.
Nov 08 21:49:53 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:49:53 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:49:53 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e92c29-2739-42d4-a853-f229e978dee0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b420f26b-c8a6-4412-9611-544a67992490]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:53 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:53 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:53 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:53 user nova-compute[75993]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde (non-flash)
Nov 08 21:49:53 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:53 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f856825c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde'): ({'sde'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Removing single pathed devices sde {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[febd39c8-0689-4ced-b486-ead399c042ab]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[52211fb7-5a07-4f8e-a5fa-db3b438f0595]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Flushing IO for device /dev/sde {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fa2be5-f202-47ec-b792-18ebdf7812e8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdb6844-82b2-423f-98ab-e3119f04437e]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] SCSI volumes sde have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[317308d9-fd8e-4f6f-a584-7763a0f6fcb8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c51379a-cb51-43cd-8430-4cddc7860a68]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde, portal: 172.16.0.220,3260]
Nov 08 21:49:53 user nova-compute[75993]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde, portal: 172.16.0.220,3260] successful.
Nov 08 21:49:53 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db1c38e9-2000-4a04-8b9c-50c7207f6dde -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[233f9116-4b96-4abb-959d-b012ceea276d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] <== disconnect_volume: return (335ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:49:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:49:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:49:54 user nova-compute[75993]: DEBUG nova.objects.instance [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'flavor' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1d2e665d-4e2e-4682-b67b-9bd2455c4716 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.909s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:49:55 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Creating image(s)
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "/opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "/opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.196s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk 1073741824" returned: 0 in 0.065s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Cannot resize image /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Ensure instance console log exists: /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Start _get_guest_xml network_info=[{"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '4b0c680b-c9e5-4263-b867-0f46ad8d22b9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XenfiCxU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f', 'attached_at': '', 'detached_at': '', 'volume_id': 'cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 'serial': 'cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:49:56 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 21:49:56 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.objects.instance [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'vcpu_model' on Instance uuid f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XenfiCxU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:49:56 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:49:56 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:49:56 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb447c74-f8c5-496e-822f-d31fa8136ea7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:49:56 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[667e2569-aca6-44a9-b1cc-a2225ea7df9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee] added
Nov 08 21:49:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7c5c05-277c-4274-9c0e-ca5a8999062e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[786ef4b2-57de-43a0-995c-68f2792db8e1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XenfiCxU {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XenfiCxU" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccabbf9-98ad-43b9-945e-23d7af3bed8a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XenfiCxU'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[875ff57c-c1b0-4b5d-be6e-00492e858977]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[524bc4fa-ee39-4f98-9c14-cef4a32acb22]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:56 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:56 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5b28d5-b3ff-46e8-8b48-95cb4361fb60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260]
Nov 08 21:49:56 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260] successful.
Nov 08 21:49:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f2a234-87c2-4686-8779-2e4e460f4556]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0bd42f-ce66-4b4e-8272-216fa0602242]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:56 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:56 user nova-compute[75993]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)
Nov 08 21:49:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:49:56 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:49:56 user nova-compute[75993]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)
Nov 08 21:49:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[535218a2-1a49-43e2-98ed-bf0079c9a912]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:49:56 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XenfiCxU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23865346363643264', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865346363643264', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T21:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1222137561',display_name='tempest-ServerActionsTestOtherA-server-871506730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1222137561',id=28,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx16iEb6CeFHI0TasVxtYtLjeV3PPjbyaq7k//aB1Zq4ApiAjvF8kHWO6ru0wGEM9NttEZOQsBaV9WtV6vPGjv/2ZDyxWsE6IzcbI1GOMvT4gB4T5MAXhahrl24BHfVYQ==',key_name='tempest-keypair-1858342574',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:46:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-laco4f50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:49:57 user nova-compute[75993]:   <uuid>f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f</uuid>
Nov 08 21:49:57 user nova-compute[75993]:   <name>instance-0000001c</name>
Nov 08 21:49:57 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:49:57 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:49:57 user nova-compute[75993]:   <metadata>
Nov 08 21:49:57 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:49:57 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:49:57 user nova-compute[75993]:       <nova:name>tempest-ServerActionsTestOtherA-server-871506730</nova:name>
Nov 08 21:49:57 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:49:56</nova:creationTime>
Nov 08 21:49:57 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:49:57 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:49:57 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:49:57 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:49:57 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:49:57 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:49:57 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:49:57 user nova-compute[75993]:       <nova:owner>
Nov 08 21:49:57 user nova-compute[75993]:         <nova:user uuid="24c7a7bdeeda41339b11c9e9e1ad4c8d">tempest-ServerActionsTestOtherA-1530278199-project-member</nova:user>
Nov 08 21:49:57 user nova-compute[75993]:         <nova:project uuid="696fc6c404c244ccba1a90b11e5437de">tempest-ServerActionsTestOtherA-1530278199</nova:project>
Nov 08 21:49:57 user nova-compute[75993]:       </nova:owner>
Nov 08 21:49:57 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:49:57 user nova-compute[75993]:       <nova:ports>
Nov 08 21:49:57 user nova-compute[75993]:         <nova:port uuid="89871e15-aec8-4d15-8672-313d84c98870">
Nov 08 21:49:57 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 21:49:57 user nova-compute[75993]:         </nova:port>
Nov 08 21:49:57 user nova-compute[75993]:       </nova:ports>
Nov 08 21:49:57 user nova-compute[75993]:     </nova:instance>
Nov 08 21:49:57 user nova-compute[75993]:   </metadata>
Nov 08 21:49:57 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:49:57 user nova-compute[75993]:     <system>
Nov 08 21:49:57 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:49:57 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:49:57 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:49:57 user nova-compute[75993]:       <entry name="serial">f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f</entry>
Nov 08 21:49:57 user nova-compute[75993]:       <entry name="uuid">f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f</entry>
Nov 08 21:49:57 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:49:57 user nova-compute[75993]:     </system>
Nov 08 21:49:57 user nova-compute[75993]:   </sysinfo>
Nov 08 21:49:57 user nova-compute[75993]:   <os>
Nov 08 21:49:57 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:49:57 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:49:57 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:49:57 user nova-compute[75993]:   </os>
Nov 08 21:49:57 user nova-compute[75993]:   <features>
Nov 08 21:49:57 user nova-compute[75993]:     <acpi/>
Nov 08 21:49:57 user nova-compute[75993]:     <apic/>
Nov 08 21:49:57 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:49:57 user nova-compute[75993]:   </features>
Nov 08 21:49:57 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:49:57 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:49:57 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:49:57 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:49:57 user nova-compute[75993]:   </clock>
Nov 08 21:49:57 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:49:57 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:49:57 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:49:57 user nova-compute[75993]:   </cpu>
Nov 08 21:49:57 user nova-compute[75993]:   <devices>
Nov 08 21:49:57 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:49:57 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:49:57 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk"/>
Nov 08 21:49:57 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:49:57 user nova-compute[75993]:     </disk>
Nov 08 21:49:57 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:49:57 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:49:57 user nova-compute[75993]:       <source dev="/dev/sdb"/>
Nov 08 21:49:57 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:49:57 user nova-compute[75993]:       <serial>cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee</serial>
Nov 08 21:49:57 user nova-compute[75993]:     </disk>
Nov 08 21:49:57 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:49:57 user nova-compute[75993]:       <mac address="fa:16:3e:16:21:b5"/>
Nov 08 21:49:57 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:49:57 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:49:57 user nova-compute[75993]:       <target dev="tap89871e15-ae"/>
Nov 08 21:49:57 user nova-compute[75993]:     </interface>
Nov 08 21:49:57 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:49:57 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/console.log" append="off"/>
Nov 08 21:49:57 user nova-compute[75993]:     </serial>
Nov 08 21:49:57 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:49:57 user nova-compute[75993]:     <video>
Nov 08 21:49:57 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:49:57 user nova-compute[75993]:     </video>
Nov 08 21:49:57 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:49:57 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:49:57 user nova-compute[75993]:     </rng>
Nov 08 21:49:57 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:49:57 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:49:57 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:49:57 user nova-compute[75993]:     </memballoon>
Nov 08 21:49:57 user nova-compute[75993]:   </devices>
Nov 08 21:49:57 user nova-compute[75993]: </domain>
Nov 08 21:49:57 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T21:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1222137561',display_name='tempest-ServerActionsTestOtherA-server-871506730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1222137561',id=28,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx16iEb6CeFHI0TasVxtYtLjeV3PPjbyaq7k//aB1Zq4ApiAjvF8kHWO6ru0wGEM9NttEZOQsBaV9WtV6vPGjv/2ZDyxWsE6IzcbI1GOMvT4gB4T5MAXhahrl24BHfVYQ==',key_name='tempest-keypair-1858342574',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:46:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-laco4f50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG os_vif [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '409ceab2-5c0b-5b1e-94aa-d9a485614d81', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89871e15-ae, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89871e15-ae, col_values=(('qos', UUID('f07c7e9d-e975-4157-be66-da4041727c25')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89871e15-ae, col_values=(('external_ids', {'iface-id': '89871e15-aec8-4d15-8672-313d84c98870', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:21:b5', 'vm-uuid': 'f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:57 user nova-compute[75993]: INFO os_vif [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae')
Nov 08 21:49:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:49:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No VIF found with MAC fa:16:3e:16:21:b5, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:49:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:49:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-34ce8ae7-f751-4a0e-bd09-96c69d0805ce req-55919572-bd79-4a14-a1b4-74e3d8c387fa service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:49:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34ce8ae7-f751-4a0e-bd09-96c69d0805ce req-55919572-bd79-4a14-a1b4-74e3d8c387fa service nova] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:49:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34ce8ae7-f751-4a0e-bd09-96c69d0805ce req-55919572-bd79-4a14-a1b4-74e3d8c387fa service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:49:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-34ce8ae7-f751-4a0e-bd09-96c69d0805ce req-55919572-bd79-4a14-a1b4-74e3d8c387fa service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:49:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-34ce8ae7-f751-4a0e-bd09-96c69d0805ce req-55919572-bd79-4a14-a1b4-74e3d8c387fa service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] No waiting events found dispatching network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:49:59 user nova-compute[75993]: WARNING nova.compute.manager [req-34ce8ae7-f751-4a0e-bd09-96c69d0805ce req-55919572-bd79-4a14-a1b4-74e3d8c387fa service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received unexpected event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 21:50:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.compute.manager [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:50:01 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Instance spawned successfully.
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.compute.manager [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-6a0aa814-3ff7-4b0b-8b73-79bf603fca4e req-344b3b89-05b8-4cf4-8d66-856a7b99dc73 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6a0aa814-3ff7-4b0b-8b73-79bf603fca4e req-344b3b89-05b8-4cf4-8d66-856a7b99dc73 service nova] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6a0aa814-3ff7-4b0b-8b73-79bf603fca4e req-344b3b89-05b8-4cf4-8d66-856a7b99dc73 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6a0aa814-3ff7-4b0b-8b73-79bf603fca4e req-344b3b89-05b8-4cf4-8d66-856a7b99dc73 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-6a0aa814-3ff7-4b0b-8b73-79bf603fca4e req-344b3b89-05b8-4cf4-8d66-856a7b99dc73 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] No waiting events found dispatching network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:50:01 user nova-compute[75993]: WARNING nova.compute.manager [req-6a0aa814-3ff7-4b0b-8b73-79bf603fca4e req-344b3b89-05b8-4cf4-8d66-856a7b99dc73 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received unexpected event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 for instance with vm_state active and task_state rebuild_spawning.
Nov 08 21:50:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG nova.objects.instance [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75993) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 08 21:50:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-61241c6d-9a0f-4408-9078-c1530d6f6ea8 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.095s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Updating instance_info_cache with network_info: [{"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:03 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:50:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:50:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:50:07 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:50:07 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7713MB free_disk=24.9888916015625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance cd48056d-13f0-4d8e-839e-0bd392c60478 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f047433f-eaaa-4b81-b97c-6aa2f1cecff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:50:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.826s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:50:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:10 user nova-compute[75993]: INFO nova.compute.manager [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Terminating instance
Nov 08 21:50:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-35be6468-56e2-42ec-b716-aeb7e94be256 req-f77ee9eb-4d61-4b37-bc6a-6cae8da6e442 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-unplugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-35be6468-56e2-42ec-b716-aeb7e94be256 req-f77ee9eb-4d61-4b37-bc6a-6cae8da6e442 service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-35be6468-56e2-42ec-b716-aeb7e94be256 req-f77ee9eb-4d61-4b37-bc6a-6cae8da6e442 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-35be6468-56e2-42ec-b716-aeb7e94be256 req-f77ee9eb-4d61-4b37-bc6a-6cae8da6e442 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-35be6468-56e2-42ec-b716-aeb7e94be256 req-f77ee9eb-4d61-4b37-bc6a-6cae8da6e442 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-unplugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-35be6468-56e2-42ec-b716-aeb7e94be256 req-f77ee9eb-4d61-4b37-bc6a-6cae8da6e442 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-unplugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:11 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Instance destroyed successfully.
Nov 08 21:50:11 user nova-compute[75993]: DEBUG nova.objects.instance [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lazy-loading 'resources' on Instance uuid f828891c-fc9f-4d73-8467-2fa0a804ffb0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1114912217',display_name='tempest-ServerActionsTestOtherB-server-1114912217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1114912217',id=16,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGWTKmgE74K9m4nW1Iy7drLyphNyDCWQasfONZutGXOVXbF1PlyC04hFpQCnQRFF8F4wUrmwbqu5NeLi338UFqYkZR8X28Kaoc+ZAStDMMSeZsea49hDL5j+Ud29ai6ZA==',key_name='tempest-keypair-19398814',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:47:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3f53e802f4154acca8aa60dd0961a959',ramdisk_id='',reservation_id='r-5fh0kiuj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1900540301',owner_user_name='tempest-ServerActionsTestOtherB-1900540301-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:47:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b800131f464e52a3b4319038d1a23a',uuid=f828891c-fc9f-4d73-8467-2fa0a804ffb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converting VIF {"id": "787ea6de-4603-481a-8262-d51b1ed365da", "address": "fa:16:3e:ed:c9:e3", "network": {"id": "3ae0aca5-9129-432c-be18-418dc7c6d09d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1271773092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3f53e802f4154acca8aa60dd0961a959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap787ea6de-46", "ovs_interfaceid": "787ea6de-4603-481a-8262-d51b1ed365da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_vif [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap787ea6de-46, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c50e1e22-9ba5-4402-9f4d-6f0f44f8d398) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:50:11 user nova-compute[75993]: INFO os_vif [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:c9:e3,bridge_name='br-int',has_traffic_filtering=True,id=787ea6de-4603-481a-8262-d51b1ed365da,network=Network(3ae0aca5-9129-432c-be18-418dc7c6d09d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap787ea6de-46')
Nov 08 21:50:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELqlHWRP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:50:11 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9febde7c-b670-4060-9030-4a8846259b3c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:50:11 user nova-compute[75993]: No targets found.
Nov 08 21:50:11 user nova-compute[75993]: iSNS:
Nov 08 21:50:11 user nova-compute[75993]: No targets found.
Nov 08 21:50:11 user nova-compute[75993]: STATIC:
Nov 08 21:50:11 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:50:11 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:50:11 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:50:11 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0
Nov 08 21:50:11 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:50:11 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:50:11 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee
Nov 08 21:50:11 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:50:11 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:50:11 user nova-compute[75993]: FIRMWARE:
Nov 08 21:50:11 user nova-compute[75993]: No targets found.
Nov 08 21:50:11 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:50:11 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:50:11 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[599bad9f-a9df-43b0-9aa6-0915bd6f11c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[78af8b5d-ef16-4d88-bb67-f118e01067e4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:50:11 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:50:11 user nova-compute[75993]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)
Nov 08 21:50:11 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:50:11 user nova-compute[75993]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 (non-flash)
Nov 08 21:50:11 user nova-compute[75993]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)
Nov 08 21:50:11 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544df28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0'): ({'sdf'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Removing single pathed devices sdf {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4854d10-324e-40b7-a745-a5ecfd0c14e9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63f2e00-43db-46fb-a183-21ba61e767a2]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Flushing IO for device /dev/sdf {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:50:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4b4d1e-438c-4eef-a7ce-f6019c1c63da]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3343dca8-6a90-4e8b-abc6-690166afc4f3]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] SCSI volumes sdf have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dcf3a6-430f-45ad-bb69-8fe368317a05]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:12 user nova-compute[75993]: INFO nova.compute.manager [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Terminating instance
Nov 08 21:50:12 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e02e1fc-055f-470c-89d3-869f0a16b490]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260]
Nov 08 21:50:12 user nova-compute[75993]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0, portal: 172.16.0.220,3260] successful.
Nov 08 21:50:12 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aecdf48-bd8b-4f46-acc9-012c71b590f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe3c8f6-57cc-4116-9ba7-4e939056b53c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] <== disconnect_volume: return (372ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:50:12 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Deleting instance files /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0_del
Nov 08 21:50:12 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Deletion of /opt/stack/data/nova/instances/f828891c-fc9f-4d73-8467-2fa0a804ffb0_del complete
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:12 user nova-compute[75993]: INFO nova.compute.manager [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-e7e7f161-1184-4ba1-b952-f97d97546189 req-ea5bb408-250d-452b-85b3-7da4fbb6df71 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Received event network-vif-unplugged-f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e7e7f161-1184-4ba1-b952-f97d97546189 req-ea5bb408-250d-452b-85b3-7da4fbb6df71 service nova] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e7e7f161-1184-4ba1-b952-f97d97546189 req-ea5bb408-250d-452b-85b3-7da4fbb6df71 service nova] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e7e7f161-1184-4ba1-b952-f97d97546189 req-ea5bb408-250d-452b-85b3-7da4fbb6df71 service nova] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-e7e7f161-1184-4ba1-b952-f97d97546189 req-ea5bb408-250d-452b-85b3-7da4fbb6df71 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] No waiting events found dispatching network-vif-unplugged-f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-e7e7f161-1184-4ba1-b952-f97d97546189 req-ea5bb408-250d-452b-85b3-7da4fbb6df71 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Received event network-vif-unplugged-f92989bc-c06f-4a11-a50d-5cd326889521 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:50:12 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Instance destroyed successfully.
Nov 08 21:50:12 user nova-compute[75993]: DEBUG nova.objects.instance [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lazy-loading 'resources' on Instance uuid cd48056d-13f0-4d8e-839e-0bd392c60478 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:45:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1190488140',display_name='tempest-TestServerVolumeAttachmentScenario-server-1190488140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1190488140',id=23,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPdycmomWxn/irc4U5i3S8vmLTiBtjxOOE39w17t4ubtuIpBNjZvaBWRoyWc6lMzcu9Q1esy0WWCCLEkNl1gyR+FdEZGIPs4z/sLfssr9pl982re/lrOWkvNX64h3arK/A==',key_name='tempest-keypair-1880530491',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:45:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='26368a5aad0648e197d89fb1b7d5f2ff',ramdisk_id='',reservation_id='r-00ly8usz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1317810676',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1317810676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:45:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='666dbffed51d4b7baa09fd58c902d90b',uuid=cd48056d-13f0-4d8e-839e-0bd392c60478,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f92989bc-c06f-4a11-a50d-5cd326889521", "address": "fa:16:3e:4d:61:3f", "network": {"id": "4e37144e-bc46-459b-b0ea-23789861dc06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1693242984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26368a5aad0648e197d89fb1b7d5f2ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92989bc-c0", "ovs_interfaceid": "f92989bc-c06f-4a11-a50d-5cd326889521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Converting VIF {"id": "f92989bc-c06f-4a11-a50d-5cd326889521", "address": "fa:16:3e:4d:61:3f", "network": {"id": "4e37144e-bc46-459b-b0ea-23789861dc06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1693242984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "26368a5aad0648e197d89fb1b7d5f2ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf92989bc-c0", "ovs_interfaceid": "f92989bc-c06f-4a11-a50d-5cd326889521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=f92989bc-c06f-4a11-a50d-5cd326889521,network=Network(4e37144e-bc46-459b-b0ea-23789861dc06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92989bc-c0') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG os_vif [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=f92989bc-c06f-4a11-a50d-5cd326889521,network=Network(4e37144e-bc46-459b-b0ea-23789861dc06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92989bc-c0') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf92989bc-c0, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fc63dbc-9b7c-454c-bc37-ca1ef9b701cb) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:13 user nova-compute[75993]: INFO os_vif [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:61:3f,bridge_name='br-int',has_traffic_filtering=True,id=f92989bc-c06f-4a11-a50d-5cd326889521,network=Network(4e37144e-bc46-459b-b0ea-23789861dc06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf92989bc-c0')
Nov 08 21:50:13 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Deleting instance files /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478_del
Nov 08 21:50:13 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Deletion of /opt/stack/data/nova/instances/cd48056d-13f0-4d8e-839e-0bd392c60478_del complete
Nov 08 21:50:13 user nova-compute[75993]: INFO nova.compute.manager [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 08 21:50:13 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:50:13 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:50:13 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:50:13 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:50:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-7d5dd4e5-8450-40ad-8e3c-b153156e2994 req-841f4df5-a635-4383-8c60-ac03986e0b52 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-deleted-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:13 user nova-compute[75993]: INFO nova.compute.manager [req-7d5dd4e5-8450-40ad-8e3c-b153156e2994 req-841f4df5-a635-4383-8c60-ac03986e0b52 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Neutron deleted interface 787ea6de-4603-481a-8262-d51b1ed365da; detaching it from the instance and deleting it from the info cache
Nov 08 21:50:13 user nova-compute[75993]: DEBUG nova.network.neutron [req-7d5dd4e5-8450-40ad-8e3c-b153156e2994 req-841f4df5-a635-4383-8c60-ac03986e0b52 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:50:13 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Took 1.05 seconds to deallocate network for instance.
Nov 08 21:50:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-7d5dd4e5-8450-40ad-8e3c-b153156e2994 req-841f4df5-a635-4383-8c60-ac03986e0b52 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Detach interface failed, port_id=787ea6de-4603-481a-8262-d51b1ed365da, reason: Instance f828891c-fc9f-4d73-8467-2fa0a804ffb0 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 21:50:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-6601ba9a-84be-4def-93ac-7724f4cfd3ec req-79c3c72e-fccb-42f1-aefb-b1459de032b2 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6601ba9a-84be-4def-93ac-7724f4cfd3ec req-79c3c72e-fccb-42f1-aefb-b1459de032b2 service nova] Acquiring lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6601ba9a-84be-4def-93ac-7724f4cfd3ec req-79c3c72e-fccb-42f1-aefb-b1459de032b2 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6601ba9a-84be-4def-93ac-7724f4cfd3ec req-79c3c72e-fccb-42f1-aefb-b1459de032b2 service nova] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-6601ba9a-84be-4def-93ac-7724f4cfd3ec req-79c3c72e-fccb-42f1-aefb-b1459de032b2 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] No waiting events found dispatching network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:50:13 user nova-compute[75993]: WARNING nova.compute.manager [req-6601ba9a-84be-4def-93ac-7724f4cfd3ec req-79c3c72e-fccb-42f1-aefb-b1459de032b2 service nova] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Received unexpected event network-vif-plugged-787ea6de-4603-481a-8262-d51b1ed365da for instance with vm_state active and task_state deleting.
Nov 08 21:50:14 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:50:14 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Took 1.17 seconds to deallocate network for instance.
Nov 08 21:50:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:14 user nova-compute[75993]: INFO nova.compute.manager [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] [instance: f828891c-fc9f-4d73-8467-2fa0a804ffb0] Took 1.09 seconds to detach 1 volumes for instance.
Nov 08 21:50:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-2af01793-23f2-401c-b83b-ddb0b0e7c99d req-32cbc0bf-8179-4ade-b811-4e53b507fd91 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Received event network-vif-plugged-f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2af01793-23f2-401c-b83b-ddb0b0e7c99d req-32cbc0bf-8179-4ade-b811-4e53b507fd91 service nova] Acquiring lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2af01793-23f2-401c-b83b-ddb0b0e7c99d req-32cbc0bf-8179-4ade-b811-4e53b507fd91 service nova] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2af01793-23f2-401c-b83b-ddb0b0e7c99d req-32cbc0bf-8179-4ade-b811-4e53b507fd91 service nova] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-2af01793-23f2-401c-b83b-ddb0b0e7c99d req-32cbc0bf-8179-4ade-b811-4e53b507fd91 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] No waiting events found dispatching network-vif-plugged-f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:50:14 user nova-compute[75993]: WARNING nova.compute.manager [req-2af01793-23f2-401c-b83b-ddb0b0e7c99d req-32cbc0bf-8179-4ade-b811-4e53b507fd91 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Received unexpected event network-vif-plugged-f92989bc-c06f-4a11-a50d-5cd326889521 for instance with vm_state deleted and task_state None.
Nov 08 21:50:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-2af01793-23f2-401c-b83b-ddb0b0e7c99d req-32cbc0bf-8179-4ade-b811-4e53b507fd91 service nova] [instance: cd48056d-13f0-4d8e-839e-0bd392c60478] Received event network-vif-deleted-f92989bc-c06f-4a11-a50d-5cd326889521 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:14 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:50:14 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:50:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.207s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:14 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Deleted allocations for instance cd48056d-13f0-4d8e-839e-0bd392c60478
Nov 08 21:50:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1c119c22-2318-4532-803c-2720542e35c6 tempest-TestServerVolumeAttachmentScenario-1317810676 tempest-TestServerVolumeAttachmentScenario-1317810676-project-member] Lock "cd48056d-13f0-4d8e-839e-0bd392c60478" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.823s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:15 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:50:15 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:50:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:15 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Deleted allocations for instance f828891c-fc9f-4d73-8467-2fa0a804ffb0
Nov 08 21:50:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b1e2cbf1-9c2d-44a9-b0b9-14b766038da3 tempest-ServerActionsTestOtherB-1900540301 tempest-ServerActionsTestOtherB-1900540301-project-member] Lock "f828891c-fc9f-4d73-8467-2fa0a804ffb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.307s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:23 user nova-compute[75993]: INFO nova.compute.manager [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Terminating instance
Nov 08 21:50:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:50:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-736b9f62-f48f-4e5d-83f7-29fc57678f41 req-0d7574ff-d2c1-4e61-8be3-a9acb5c8f581 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-unplugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-736b9f62-f48f-4e5d-83f7-29fc57678f41 req-0d7574ff-d2c1-4e61-8be3-a9acb5c8f581 service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-736b9f62-f48f-4e5d-83f7-29fc57678f41 req-0d7574ff-d2c1-4e61-8be3-a9acb5c8f581 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-736b9f62-f48f-4e5d-83f7-29fc57678f41 req-0d7574ff-d2c1-4e61-8be3-a9acb5c8f581 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-736b9f62-f48f-4e5d-83f7-29fc57678f41 req-0d7574ff-d2c1-4e61-8be3-a9acb5c8f581 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-unplugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-736b9f62-f48f-4e5d-83f7-29fc57678f41 req-0d7574ff-d2c1-4e61-8be3-a9acb5c8f581 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-unplugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:50:24 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Instance destroyed successfully.
Nov 08 21:50:24 user nova-compute[75993]: DEBUG nova.objects.instance [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lazy-loading 'resources' on Instance uuid 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2110782090',display_name='tempest-ServerStableDeviceRescueTest-server-2110782090',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2110782090',id=20,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFMN3lC7vsEkbnadUPTnIr2Jya1/3yi+51p6/n72zhb4uMU3OFUR7/aRNmvgHj88ClY4o03jV8JtlakKqT3cQOcLTpQ4HYKpK1Ff1ZAClAyOauC8xW9s99eqeqsUlkqGrw==',key_name='tempest-keypair-1465265887',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:47:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd6082215e9b4000909b766f682d4ea1',ramdisk_id='',reservation_id='r-j02wgz8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-370267439',owner_user_name='tempest-ServerStableDeviceRescueTest-370267439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:49:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3248c726b00543bdb2cb218afbf8d803',uuid=7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Converting VIF {"id": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "address": "fa:16:3e:f2:0f:71", "network": {"id": "8de4945b-2e2b-4b1a-8b14-12dfbe408cba", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-121723068-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd6082215e9b4000909b766f682d4ea1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fa21b8f-26", "ovs_interfaceid": "0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0f:71,bridge_name='br-int',has_traffic_filtering=True,id=0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca,network=Network(8de4945b-2e2b-4b1a-8b14-12dfbe408cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa21b8f-26') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG os_vif [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0f:71,bridge_name='br-int',has_traffic_filtering=True,id=0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca,network=Network(8de4945b-2e2b-4b1a-8b14-12dfbe408cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa21b8f-26') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fa21b8f-26, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=961940cc-e8d1-4b60-8cce-50c0c7a90d86) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:50:24 user nova-compute[75993]: INFO os_vif [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:0f:71,bridge_name='br-int',has_traffic_filtering=True,id=0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca,network=Network(8de4945b-2e2b-4b1a-8b14-12dfbe408cba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fa21b8f-26')
Nov 08 21:50:24 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Deleting instance files /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2_del
Nov 08 21:50:24 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Deletion of /opt/stack/data/nova/instances/7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2_del complete
Nov 08 21:50:24 user nova-compute[75993]: INFO nova.compute.manager [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 21:50:24 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:50:24 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:50:25 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:50:25 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Took 1.08 seconds to deallocate network for instance.
Nov 08 21:50:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:26 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:50:26 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:50:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:26 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Deleted allocations for instance 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2
Nov 08 21:50:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-dc8e8624-60c5-40d5-995b-80e3dc9b126e req-2b68b8f2-e313-4fdb-9e6d-0fecf81b80b5 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dc8e8624-60c5-40d5-995b-80e3dc9b126e req-2b68b8f2-e313-4fdb-9e6d-0fecf81b80b5 service nova] Acquiring lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dc8e8624-60c5-40d5-995b-80e3dc9b126e req-2b68b8f2-e313-4fdb-9e6d-0fecf81b80b5 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dc8e8624-60c5-40d5-995b-80e3dc9b126e req-2b68b8f2-e313-4fdb-9e6d-0fecf81b80b5 service nova] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-dc8e8624-60c5-40d5-995b-80e3dc9b126e req-2b68b8f2-e313-4fdb-9e6d-0fecf81b80b5 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] No waiting events found dispatching network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:50:26 user nova-compute[75993]: WARNING nova.compute.manager [req-dc8e8624-60c5-40d5-995b-80e3dc9b126e req-2b68b8f2-e313-4fdb-9e6d-0fecf81b80b5 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received unexpected event network-vif-plugged-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca for instance with vm_state deleted and task_state None.
Nov 08 21:50:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-dc8e8624-60c5-40d5-995b-80e3dc9b126e req-2b68b8f2-e313-4fdb-9e6d-0fecf81b80b5 service nova] [instance: 7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2] Received event network-vif-deleted-0fa21b8f-2641-44fe-8aa6-5e5cfc22d5ca {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-62f7859b-3abf-4a96-a2af-b41425832d39 tempest-ServerStableDeviceRescueTest-370267439 tempest-ServerStableDeviceRescueTest-370267439-project-member] Lock "7f9e83d6-7bd1-4f31-8a1b-a626978ac4f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.517s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid e7d6503c-765f-4652-8865-e6494e6f58d2 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 1f2e921c-69cc-496c-9e19-561dcfd00a72 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 91fae199-114f-4f67-b48d-1e74ede28d32 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 64d8c15c-0ac9-434b-852a-123a940dc0ae {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid f047433f-eaaa-4b81-b97c-6aa2f1cecff0 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "adef30df-4254-4133-9db2-4c7708cd1996" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "91fae199-114f-4f67-b48d-1e74ede28d32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "adef30df-4254-4133-9db2-4c7708cd1996" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "91fae199-114f-4f67-b48d-1e74ede28d32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "41c2971c-5db5-4951-8adf-ffbe063498dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:50:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:48 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:50:48 user nova-compute[75993]: INFO nova.compute.claims [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Claim successful on node user
Nov 08 21:50:49 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG nova.network.neutron [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:50:49 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:50:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG nova.policy [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b330b61ef9cd48bdacbb7a7a695f34cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b942ec0575e4665a594614ccba455d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:50:49 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Creating image(s)
Nov 08 21:50:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "/opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "/opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "/opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.237s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG nova.network.neutron [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Successfully created port: ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk 1073741824" returned: 0 in 0.048s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.188s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Checking if we can resize image /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Cannot resize image /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Ensure instance console log exists: /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG nova.network.neutron [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Successfully updated port: ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "refresh_cache-41c2971c-5db5-4951-8adf-ffbe063498dc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquired lock "refresh_cache-41c2971c-5db5-4951-8adf-ffbe063498dc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG nova.network.neutron [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-9523c6c7-cc6f-42b7-af48-f76ce1072b11 req-a6899a69-a89e-49be-934c-086bd1504969 service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Received event network-changed-ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-9523c6c7-cc6f-42b7-af48-f76ce1072b11 req-a6899a69-a89e-49be-934c-086bd1504969 service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Refreshing instance network info cache due to event network-changed-ef176aaa-2d27-4798-a4c8-e522e717bca3. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9523c6c7-cc6f-42b7-af48-f76ce1072b11 req-a6899a69-a89e-49be-934c-086bd1504969 service nova] Acquiring lock "refresh_cache-41c2971c-5db5-4951-8adf-ffbe063498dc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:50:50 user nova-compute[75993]: DEBUG nova.network.neutron [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.network.neutron [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Updating instance_info_cache with network_info: [{"id": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "address": "fa:16:3e:34:e9:65", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef176aaa-2d", "ovs_interfaceid": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Releasing lock "refresh_cache-41c2971c-5db5-4951-8adf-ffbe063498dc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Instance network_info: |[{"id": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "address": "fa:16:3e:34:e9:65", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef176aaa-2d", "ovs_interfaceid": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9523c6c7-cc6f-42b7-af48-f76ce1072b11 req-a6899a69-a89e-49be-934c-086bd1504969 service nova] Acquired lock "refresh_cache-41c2971c-5db5-4951-8adf-ffbe063498dc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.network.neutron [req-9523c6c7-cc6f-42b7-af48-f76ce1072b11 req-a6899a69-a89e-49be-934c-086bd1504969 service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Refreshing network info cache for port ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Start _get_guest_xml network_info=[{"id": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "address": "fa:16:3e:34:e9:65", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef176aaa-2d", "ovs_interfaceid": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:50:51 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:50:51 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-763946221',display_name='tempest-VolumesSnapshotTestJSON-instance-763946221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-763946221',id=29,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1CwvlP6OoJR4hMt+xo8FAm4z1VRPDT1rk7ix6D0hsMJN5jLXjidnxJHmHM3rYVuZ/NauDFh6TkV9kWjZONC4tscTeutZT4LxmtNjK3GyQ+YUqUKfsMIpL0dhv3Vfmnpg==',key_name='tempest-keypair-1795797978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b942ec0575e4665a594614ccba455d3',ramdisk_id='',reservation_id='r-1660q65m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072091596',owner_user_name='tempest-VolumesSnapshotTestJSON-1072091596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b330b61ef9cd48bdacbb7a7a695f34cb',uuid=41c2971c-5db5-4951-8adf-ffbe063498dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "address": "fa:16:3e:34:e9:65", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef176aaa-2d", "ovs_interfaceid": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converting VIF {"id": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "address": "fa:16:3e:34:e9:65", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef176aaa-2d", "ovs_interfaceid": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:e9:65,bridge_name='br-int',has_traffic_filtering=True,id=ef176aaa-2d27-4798-a4c8-e522e717bca3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef176aaa-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.objects.instance [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lazy-loading 'pci_devices' on Instance uuid 41c2971c-5db5-4951-8adf-ffbe063498dc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:50:51 user nova-compute[75993]:   <uuid>41c2971c-5db5-4951-8adf-ffbe063498dc</uuid>
Nov 08 21:50:51 user nova-compute[75993]:   <name>instance-0000001d</name>
Nov 08 21:50:51 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:50:51 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:50:51 user nova-compute[75993]:   <metadata>
Nov 08 21:50:51 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:50:51 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:50:51 user nova-compute[75993]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-763946221</nova:name>
Nov 08 21:50:51 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:50:51</nova:creationTime>
Nov 08 21:50:51 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:50:51 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:50:51 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:50:51 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:50:51 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:50:51 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:50:51 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:50:51 user nova-compute[75993]:       <nova:owner>
Nov 08 21:50:51 user nova-compute[75993]:         <nova:user uuid="b330b61ef9cd48bdacbb7a7a695f34cb">tempest-VolumesSnapshotTestJSON-1072091596-project-member</nova:user>
Nov 08 21:50:51 user nova-compute[75993]:         <nova:project uuid="0b942ec0575e4665a594614ccba455d3">tempest-VolumesSnapshotTestJSON-1072091596</nova:project>
Nov 08 21:50:51 user nova-compute[75993]:       </nova:owner>
Nov 08 21:50:51 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:50:51 user nova-compute[75993]:       <nova:ports>
Nov 08 21:50:51 user nova-compute[75993]:         <nova:port uuid="ef176aaa-2d27-4798-a4c8-e522e717bca3">
Nov 08 21:50:51 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 21:50:51 user nova-compute[75993]:         </nova:port>
Nov 08 21:50:51 user nova-compute[75993]:       </nova:ports>
Nov 08 21:50:51 user nova-compute[75993]:     </nova:instance>
Nov 08 21:50:51 user nova-compute[75993]:   </metadata>
Nov 08 21:50:51 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:50:51 user nova-compute[75993]:     <system>
Nov 08 21:50:51 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:50:51 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:50:51 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:50:51 user nova-compute[75993]:       <entry name="serial">41c2971c-5db5-4951-8adf-ffbe063498dc</entry>
Nov 08 21:50:51 user nova-compute[75993]:       <entry name="uuid">41c2971c-5db5-4951-8adf-ffbe063498dc</entry>
Nov 08 21:50:51 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:50:51 user nova-compute[75993]:     </system>
Nov 08 21:50:51 user nova-compute[75993]:   </sysinfo>
Nov 08 21:50:51 user nova-compute[75993]:   <os>
Nov 08 21:50:51 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:50:51 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:50:51 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:50:51 user nova-compute[75993]:   </os>
Nov 08 21:50:51 user nova-compute[75993]:   <features>
Nov 08 21:50:51 user nova-compute[75993]:     <acpi/>
Nov 08 21:50:51 user nova-compute[75993]:     <apic/>
Nov 08 21:50:51 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:50:51 user nova-compute[75993]:   </features>
Nov 08 21:50:51 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:50:51 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:50:51 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:50:51 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:50:51 user nova-compute[75993]:   </clock>
Nov 08 21:50:51 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:50:51 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:50:51 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:50:51 user nova-compute[75993]:   </cpu>
Nov 08 21:50:51 user nova-compute[75993]:   <devices>
Nov 08 21:50:51 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:50:51 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:50:51 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk"/>
Nov 08 21:50:51 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:50:51 user nova-compute[75993]:     </disk>
Nov 08 21:50:51 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:50:51 user nova-compute[75993]:       <mac address="fa:16:3e:34:e9:65"/>
Nov 08 21:50:51 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:50:51 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:50:51 user nova-compute[75993]:       <target dev="tapef176aaa-2d"/>
Nov 08 21:50:51 user nova-compute[75993]:     </interface>
Nov 08 21:50:51 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:50:51 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/console.log" append="off"/>
Nov 08 21:50:51 user nova-compute[75993]:     </serial>
Nov 08 21:50:51 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:50:51 user nova-compute[75993]:     <video>
Nov 08 21:50:51 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:50:51 user nova-compute[75993]:     </video>
Nov 08 21:50:51 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:50:51 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:50:51 user nova-compute[75993]:     </rng>
Nov 08 21:50:51 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:50:51 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:50:51 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:50:51 user nova-compute[75993]:     </memballoon>
Nov 08 21:50:51 user nova-compute[75993]:   </devices>
Nov 08 21:50:51 user nova-compute[75993]: </domain>
Nov 08 21:50:51 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-763946221',display_name='tempest-VolumesSnapshotTestJSON-instance-763946221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-763946221',id=29,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1CwvlP6OoJR4hMt+xo8FAm4z1VRPDT1rk7ix6D0hsMJN5jLXjidnxJHmHM3rYVuZ/NauDFh6TkV9kWjZONC4tscTeutZT4LxmtNjK3GyQ+YUqUKfsMIpL0dhv3Vfmnpg==',key_name='tempest-keypair-1795797978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b942ec0575e4665a594614ccba455d3',ramdisk_id='',reservation_id='r-1660q65m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1072091596',owner_user_name='tempest-VolumesSnapshotTestJSON-1072091596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:50:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b330b61ef9cd48bdacbb7a7a695f34cb',uuid=41c2971c-5db5-4951-8adf-ffbe063498dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "address": "fa:16:3e:34:e9:65", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef176aaa-2d", "ovs_interfaceid": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converting VIF {"id": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "address": "fa:16:3e:34:e9:65", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef176aaa-2d", "ovs_interfaceid": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:e9:65,bridge_name='br-int',has_traffic_filtering=True,id=ef176aaa-2d27-4798-a4c8-e522e717bca3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef176aaa-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG os_vif [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:e9:65,bridge_name='br-int',has_traffic_filtering=True,id=ef176aaa-2d27-4798-a4c8-e522e717bca3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef176aaa-2d') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d7c6a48-102b-559c-b033-c59446ea4f73', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef176aaa-2d, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef176aaa-2d, col_values=(('qos', UUID('265c6232-5f04-4a54-8c45-e71443b94f16')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef176aaa-2d, col_values=(('external_ids', {'iface-id': 'ef176aaa-2d27-4798-a4c8-e522e717bca3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:e9:65', 'vm-uuid': '41c2971c-5db5-4951-8adf-ffbe063498dc'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:51 user nova-compute[75993]: INFO os_vif [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:e9:65,bridge_name='br-int',has_traffic_filtering=True,id=ef176aaa-2d27-4798-a4c8-e522e717bca3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef176aaa-2d')
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] No VIF found with MAC fa:16:3e:34:e9:65, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.network.neutron [req-9523c6c7-cc6f-42b7-af48-f76ce1072b11 req-a6899a69-a89e-49be-934c-086bd1504969 service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Updated VIF entry in instance network info cache for port ef176aaa-2d27-4798-a4c8-e522e717bca3. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG nova.network.neutron [req-9523c6c7-cc6f-42b7-af48-f76ce1072b11 req-a6899a69-a89e-49be-934c-086bd1504969 service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Updating instance_info_cache with network_info: [{"id": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "address": "fa:16:3e:34:e9:65", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef176aaa-2d", "ovs_interfaceid": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:50:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9523c6c7-cc6f-42b7-af48-f76ce1072b11 req-a6899a69-a89e-49be-934c-086bd1504969 service nova] Releasing lock "refresh_cache-41c2971c-5db5-4951-8adf-ffbe063498dc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:50:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-9480b233-c515-4bb0-92d6-41ecedf0dc71 req-c2a6d3e1-cecc-402d-b6a3-a687346c62de service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Received event network-vif-plugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9480b233-c515-4bb0-92d6-41ecedf0dc71 req-c2a6d3e1-cecc-402d-b6a3-a687346c62de service nova] Acquiring lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9480b233-c515-4bb0-92d6-41ecedf0dc71 req-c2a6d3e1-cecc-402d-b6a3-a687346c62de service nova] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9480b233-c515-4bb0-92d6-41ecedf0dc71 req-c2a6d3e1-cecc-402d-b6a3-a687346c62de service nova] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-9480b233-c515-4bb0-92d6-41ecedf0dc71 req-c2a6d3e1-cecc-402d-b6a3-a687346c62de service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] No waiting events found dispatching network-vif-plugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:50:52 user nova-compute[75993]: WARNING nova.compute.manager [req-9480b233-c515-4bb0-92d6-41ecedf0dc71 req-c2a6d3e1-cecc-402d-b6a3-a687346c62de service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Received unexpected event network-vif-plugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 for instance with vm_state building and task_state spawning.
Nov 08 21:50:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:54 user nova-compute[75993]: DEBUG nova.compute.manager [req-b3abf10e-072f-4a5a-8351-62acc3f34fef req-027fa2d4-2f45-47de-af92-25fa43ef5d6c service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Received event network-vif-plugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:50:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b3abf10e-072f-4a5a-8351-62acc3f34fef req-027fa2d4-2f45-47de-af92-25fa43ef5d6c service nova] Acquiring lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:50:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b3abf10e-072f-4a5a-8351-62acc3f34fef req-027fa2d4-2f45-47de-af92-25fa43ef5d6c service nova] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:50:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-b3abf10e-072f-4a5a-8351-62acc3f34fef req-027fa2d4-2f45-47de-af92-25fa43ef5d6c service nova] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:55 user nova-compute[75993]: DEBUG nova.compute.manager [req-b3abf10e-072f-4a5a-8351-62acc3f34fef req-027fa2d4-2f45-47de-af92-25fa43ef5d6c service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] No waiting events found dispatching network-vif-plugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:50:55 user nova-compute[75993]: WARNING nova.compute.manager [req-b3abf10e-072f-4a5a-8351-62acc3f34fef req-027fa2d4-2f45-47de-af92-25fa43ef5d6c service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Received unexpected event network-vif-plugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 for instance with vm_state building and task_state spawning.
Nov 08 21:50:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:50:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:50:55 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Instance spawned successfully.
Nov 08 21:50:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:50:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:50:55 user nova-compute[75993]: INFO nova.compute.manager [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Took 5.67 seconds to spawn the instance on the hypervisor.
Nov 08 21:50:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:50:55 user nova-compute[75993]: INFO nova.compute.manager [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Took 6.68 seconds to build instance.
Nov 08 21:50:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-83abfcfd-f6f3-4db9-b25b-09373b999c26 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.782s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:50:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:50:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:50:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:01 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:51:01 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:51:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:01 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:51:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:01 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:02 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:51:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:51:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:05 user nova-compute[75993]: INFO nova.compute.manager [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Terminating instance
Nov 08 21:51:05 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:51:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-96d934fe-6fbc-409a-ae3c-85000ba99fd2 req-06227890-568f-4460-baaa-ce3a20c1aa4c service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received event network-vif-unplugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-96d934fe-6fbc-409a-ae3c-85000ba99fd2 req-06227890-568f-4460-baaa-ce3a20c1aa4c service nova] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-96d934fe-6fbc-409a-ae3c-85000ba99fd2 req-06227890-568f-4460-baaa-ce3a20c1aa4c service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-96d934fe-6fbc-409a-ae3c-85000ba99fd2 req-06227890-568f-4460-baaa-ce3a20c1aa4c service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-96d934fe-6fbc-409a-ae3c-85000ba99fd2 req-06227890-568f-4460-baaa-ce3a20c1aa4c service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] No waiting events found dispatching network-vif-unplugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-96d934fe-6fbc-409a-ae3c-85000ba99fd2 req-06227890-568f-4460-baaa-ce3a20c1aa4c service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received event network-vif-unplugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:51:06 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:51:06 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7919MB free_disk=25.129196166992188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Instance destroyed successfully.
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.objects.instance [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'resources' on Instance uuid e7d6503c-765f-4652-8865-e6494e6f58d2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:33:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1971321515',display_name='tempest-ServerRescueNegativeTestJSON-server-1971321515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1971321515',id=2,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:35:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-ir161ktw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:35:55Z,user_data=None,user_id='37e02c3f49f1467498623a47a979a65d',uuid=e7d6503c-765f-4652-8865-e6494e6f58d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "address": "fa:16:3e:fc:64:c6", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc9ca8a3-f4", "ovs_interfaceid": "bc9ca8a3-f4c5-4268-b587-dd6e8103ba02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:64:c6,bridge_name='br-int',has_traffic_filtering=True,id=bc9ca8a3-f4c5-4268-b587-dd6e8103ba02,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9ca8a3-f4') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG os_vif [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:64:c6,bridge_name='br-int',has_traffic_filtering=True,id=bc9ca8a3-f4c5-4268-b587-dd6e8103ba02,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9ca8a3-f4') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc9ca8a3-f4, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ca5a497-aadc-4674-a549-1fc6c1c40e6d) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:51:06 user nova-compute[75993]: INFO os_vif [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:64:c6,bridge_name='br-int',has_traffic_filtering=True,id=bc9ca8a3-f4c5-4268-b587-dd6e8103ba02,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc9ca8a3-f4')
Nov 08 21:51:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Deleting instance files /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2_del
Nov 08 21:51:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Deletion of /opt/stack/data/nova/instances/e7d6503c-765f-4652-8865-e6494e6f58d2_del complete
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance adef30df-4254-4133-9db2-4c7708cd1996 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance e7d6503c-765f-4652-8865-e6494e6f58d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f047433f-eaaa-4b81-b97c-6aa2f1cecff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 41c2971c-5db5-4951-8adf-ffbe063498dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:51:06 user nova-compute[75993]: INFO nova.compute.manager [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 08 21:51:06 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:51:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:51:07 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Took 0.51 seconds to deallocate network for instance.
Nov 08 21:51:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:07 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Deleted allocations for instance e7d6503c-765f-4652-8865-e6494e6f58d2
Nov 08 21:51:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d0335561-8006-42b5-be56-6bee15bf2fed tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.543s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-07808262-94ce-4537-9049-13749c69852a req-c5246a6e-9e00-449b-9323-058bd35ec2c8 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-07808262-94ce-4537-9049-13749c69852a req-c5246a6e-9e00-449b-9323-058bd35ec2c8 service nova] Acquiring lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-07808262-94ce-4537-9049-13749c69852a req-c5246a6e-9e00-449b-9323-058bd35ec2c8 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-07808262-94ce-4537-9049-13749c69852a req-c5246a6e-9e00-449b-9323-058bd35ec2c8 service nova] Lock "e7d6503c-765f-4652-8865-e6494e6f58d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-07808262-94ce-4537-9049-13749c69852a req-c5246a6e-9e00-449b-9323-058bd35ec2c8 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] No waiting events found dispatching network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:07 user nova-compute[75993]: WARNING nova.compute.manager [req-07808262-94ce-4537-9049-13749c69852a req-c5246a6e-9e00-449b-9323-058bd35ec2c8 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received unexpected event network-vif-plugged-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 for instance with vm_state deleted and task_state None.
Nov 08 21:51:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-07808262-94ce-4537-9049-13749c69852a req-c5246a6e-9e00-449b-9323-058bd35ec2c8 service nova] [instance: e7d6503c-765f-4652-8865-e6494e6f58d2] Received event network-vif-deleted-bc9ca8a3-f4c5-4268-b587-dd6e8103ba02 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:51:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:51:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:51:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:51:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:51:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updating instance_info_cache with network_info: [{"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:51:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:51:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:51:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:51:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:51:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:51:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:51:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:51:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:51:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:51:18 user nova-compute[75993]: INFO nova.compute.claims [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Claim successful on node user
Nov 08 21:51:18 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG nova.network.neutron [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:51:18 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:51:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG nova.policy [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17537606bbf046cd84a615eb779bab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcb84908fd7c41c29be354f4710f3296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:51:18 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Creating image(s)
Nov 08 21:51:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "/opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "/opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "/opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "ca3fe38bddc216173d7b6abbcd26c07fe260e8e0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "ca3fe38bddc216173d7b6abbcd26c07fe260e8e0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0.part --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0.part --force-share --output=json" returned: 0 in 0.249s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:19 user nova-compute[75993]: DEBUG nova.virt.images [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] 373173d6-6b3f-47e7-b7fb-7b1d4746676c was qcow2, converting to raw {{(pid=75993) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 21:51:19 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:51:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0.part /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0.converted {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0.part /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0.converted" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0.converted --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Successfully created port: 5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0.converted --force-share --output=json" returned: 0 in 0.296s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "ca3fe38bddc216173d7b6abbcd26c07fe260e8e0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.179s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0 --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "ca3fe38bddc216173d7b6abbcd26c07fe260e8e0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "ca3fe38bddc216173d7b6abbcd26c07fe260e8e0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0 --force-share --output=json" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0,backing_fmt=raw /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0,backing_fmt=raw /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk 1073741824" returned: 0 in 0.063s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "ca3fe38bddc216173d7b6abbcd26c07fe260e8e0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0 --force-share --output=json" returned: 0 in 0.259s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Successfully updated port: 5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-0aa38ecf-a004-4835-a180-9434a6453831 req-c1b3111a-868a-4608-9ca1-3f9fd035530e service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-changed-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-0aa38ecf-a004-4835-a180-9434a6453831 req-c1b3111a-868a-4608-9ca1-3f9fd035530e service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Refreshing instance network info cache due to event network-changed-5659f008-dda6-4153-b5fb-8cc33eba94ee. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0aa38ecf-a004-4835-a180-9434a6453831 req-c1b3111a-868a-4608-9ca1-3f9fd035530e service nova] Acquiring lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0aa38ecf-a004-4835-a180-9434a6453831 req-c1b3111a-868a-4608-9ca1-3f9fd035530e service nova] Acquired lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG nova.network.neutron [req-0aa38ecf-a004-4835-a180-9434a6453831 req-c1b3111a-868a-4608-9ca1-3f9fd035530e service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Refreshing network info cache for port 5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:51:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.network.neutron [req-0aa38ecf-a004-4835-a180-9434a6453831 req-c1b3111a-868a-4608-9ca1-3f9fd035530e service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Cannot resize image /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Ensure instance console log exists: /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.network.neutron [req-0aa38ecf-a004-4835-a180-9434a6453831 req-c1b3111a-868a-4608-9ca1-3f9fd035530e service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0aa38ecf-a004-4835-a180-9434a6453831 req-c1b3111a-868a-4608-9ca1-3f9fd035530e service nova] Releasing lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquired lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.network.neutron [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.network.neutron [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.network.neutron [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updating instance_info_cache with network_info: [{"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Releasing lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.compute.manager [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Instance network_info: |[{"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Start _get_guest_xml network_info=[{"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:51:15Z,direct_url=<?>,disk_format='qcow2',id=373173d6-6b3f-47e7-b7fb-7b1d4746676c,min_disk=0,min_ram=0,name='tempest-scenario-img--156402519',owner='dcb84908fd7c41c29be354f4710f3296',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:51:17Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '373173d6-6b3f-47e7-b7fb-7b1d4746676c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:51:21 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:51:21 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:51:15Z,direct_url=<?>,disk_format='qcow2',id=373173d6-6b3f-47e7-b7fb-7b1d4746676c,min_disk=0,min_ram=0,name='tempest-scenario-img--156402519',owner='dcb84908fd7c41c29be354f4710f3296',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:51:17Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1820678847',display_name='tempest-TestMinimumBasicScenario-server-1820678847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1820678847',id=30,image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOcUNJ7stKb3KMtT8FxSOLLSev5GAWF4OsBnjWBDFeteLo8WKtCXD+UDLNpLVmo+wgU/JW1M0/sLMFfbSLkzBHfxPeTYrhTogzbuJVsaLeyXpOa5ZXWQL0lTt6/I1AT2A==',key_name='tempest-TestMinimumBasicScenario-1248998495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcb84908fd7c41c29be354f4710f3296',ramdisk_id='',reservation_id='r-je062l15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1615594861',owner_user_name='tempest-TestMinimumBasicScenario-1615594861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:51:19Z,user_data=None,user_id='17537606bbf046cd84a615eb779bab16',uuid=42555213-8dfd-4b93-8827-2b72ae3ca2e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converting VIF {"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.objects.instance [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'pci_devices' on Instance uuid 42555213-8dfd-4b93-8827-2b72ae3ca2e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:51:21 user nova-compute[75993]:   <uuid>42555213-8dfd-4b93-8827-2b72ae3ca2e9</uuid>
Nov 08 21:51:21 user nova-compute[75993]:   <name>instance-0000001e</name>
Nov 08 21:51:21 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:51:21 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:51:21 user nova-compute[75993]:   <metadata>
Nov 08 21:51:21 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:51:21 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:51:21 user nova-compute[75993]:       <nova:name>tempest-TestMinimumBasicScenario-server-1820678847</nova:name>
Nov 08 21:51:21 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:51:21</nova:creationTime>
Nov 08 21:51:21 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:51:21 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:51:21 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:51:21 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:51:21 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:51:21 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:51:21 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:51:21 user nova-compute[75993]:       <nova:owner>
Nov 08 21:51:21 user nova-compute[75993]:         <nova:user uuid="17537606bbf046cd84a615eb779bab16">tempest-TestMinimumBasicScenario-1615594861-project-member</nova:user>
Nov 08 21:51:21 user nova-compute[75993]:         <nova:project uuid="dcb84908fd7c41c29be354f4710f3296">tempest-TestMinimumBasicScenario-1615594861</nova:project>
Nov 08 21:51:21 user nova-compute[75993]:       </nova:owner>
Nov 08 21:51:21 user nova-compute[75993]:       <nova:root type="image" uuid="373173d6-6b3f-47e7-b7fb-7b1d4746676c"/>
Nov 08 21:51:21 user nova-compute[75993]:       <nova:ports>
Nov 08 21:51:21 user nova-compute[75993]:         <nova:port uuid="5659f008-dda6-4153-b5fb-8cc33eba94ee">
Nov 08 21:51:21 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 21:51:21 user nova-compute[75993]:         </nova:port>
Nov 08 21:51:21 user nova-compute[75993]:       </nova:ports>
Nov 08 21:51:21 user nova-compute[75993]:     </nova:instance>
Nov 08 21:51:21 user nova-compute[75993]:   </metadata>
Nov 08 21:51:21 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:51:21 user nova-compute[75993]:     <system>
Nov 08 21:51:21 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:51:21 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:51:21 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:51:21 user nova-compute[75993]:       <entry name="serial">42555213-8dfd-4b93-8827-2b72ae3ca2e9</entry>
Nov 08 21:51:21 user nova-compute[75993]:       <entry name="uuid">42555213-8dfd-4b93-8827-2b72ae3ca2e9</entry>
Nov 08 21:51:21 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:51:21 user nova-compute[75993]:     </system>
Nov 08 21:51:21 user nova-compute[75993]:   </sysinfo>
Nov 08 21:51:21 user nova-compute[75993]:   <os>
Nov 08 21:51:21 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:51:21 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:51:21 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:51:21 user nova-compute[75993]:   </os>
Nov 08 21:51:21 user nova-compute[75993]:   <features>
Nov 08 21:51:21 user nova-compute[75993]:     <acpi/>
Nov 08 21:51:21 user nova-compute[75993]:     <apic/>
Nov 08 21:51:21 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:51:21 user nova-compute[75993]:   </features>
Nov 08 21:51:21 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:51:21 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:51:21 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:51:21 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:51:21 user nova-compute[75993]:   </clock>
Nov 08 21:51:21 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:51:21 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:51:21 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:51:21 user nova-compute[75993]:   </cpu>
Nov 08 21:51:21 user nova-compute[75993]:   <devices>
Nov 08 21:51:21 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:51:21 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:51:21 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk"/>
Nov 08 21:51:21 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:51:21 user nova-compute[75993]:     </disk>
Nov 08 21:51:21 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:51:21 user nova-compute[75993]:       <mac address="fa:16:3e:19:82:5e"/>
Nov 08 21:51:21 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:51:21 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:51:21 user nova-compute[75993]:       <target dev="tap5659f008-dd"/>
Nov 08 21:51:21 user nova-compute[75993]:     </interface>
Nov 08 21:51:21 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:51:21 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/console.log" append="off"/>
Nov 08 21:51:21 user nova-compute[75993]:     </serial>
Nov 08 21:51:21 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:51:21 user nova-compute[75993]:     <video>
Nov 08 21:51:21 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:51:21 user nova-compute[75993]:     </video>
Nov 08 21:51:21 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:51:21 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:51:21 user nova-compute[75993]:     </rng>
Nov 08 21:51:21 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:51:21 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:51:21 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:51:21 user nova-compute[75993]:     </memballoon>
Nov 08 21:51:21 user nova-compute[75993]:   </devices>
Nov 08 21:51:21 user nova-compute[75993]: </domain>
Nov 08 21:51:21 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1820678847',display_name='tempest-TestMinimumBasicScenario-server-1820678847',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1820678847',id=30,image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOcUNJ7stKb3KMtT8FxSOLLSev5GAWF4OsBnjWBDFeteLo8WKtCXD+UDLNpLVmo+wgU/JW1M0/sLMFfbSLkzBHfxPeTYrhTogzbuJVsaLeyXpOa5ZXWQL0lTt6/I1AT2A==',key_name='tempest-TestMinimumBasicScenario-1248998495',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcb84908fd7c41c29be354f4710f3296',ramdisk_id='',reservation_id='r-je062l15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1615594861',owner_user_name='tempest-TestMinimumBasicScenario-1615594861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:51:19Z,user_data=None,user_id='17537606bbf046cd84a615eb779bab16',uuid=42555213-8dfd-4b93-8827-2b72ae3ca2e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converting VIF {"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG os_vif [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c666563-e3fd-5b1a-b0cf-1b105576a60d', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5659f008-dd, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5659f008-dd, col_values=(('qos', UUID('1995cba5-5e69-4cd2-b308-fa3e1c4f48c1')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5659f008-dd, col_values=(('external_ids', {'iface-id': '5659f008-dda6-4153-b5fb-8cc33eba94ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:82:5e', 'vm-uuid': '42555213-8dfd-4b93-8827-2b72ae3ca2e9'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:21 user nova-compute[75993]: INFO os_vif [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd')
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:51:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] No VIF found with MAC fa:16:3e:19:82:5e, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:51:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-cd7e583f-7aae-4466-9176-99d0e0129170 req-d51cd079-b705-439f-8d22-d9e36396c7b9 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cd7e583f-7aae-4466-9176-99d0e0129170 req-d51cd079-b705-439f-8d22-d9e36396c7b9 service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cd7e583f-7aae-4466-9176-99d0e0129170 req-d51cd079-b705-439f-8d22-d9e36396c7b9 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cd7e583f-7aae-4466-9176-99d0e0129170 req-d51cd079-b705-439f-8d22-d9e36396c7b9 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-cd7e583f-7aae-4466-9176-99d0e0129170 req-d51cd079-b705-439f-8d22-d9e36396c7b9 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:23 user nova-compute[75993]: WARNING nova.compute.manager [req-cd7e583f-7aae-4466-9176-99d0e0129170 req-d51cd079-b705-439f-8d22-d9e36396c7b9 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received unexpected event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with vm_state building and task_state spawning.
Nov 08 21:51:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-cf118336-8f96-4362-890d-9dc88e162ac5 req-3838b8f1-1699-4820-a2af-919f6197f17e service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cf118336-8f96-4362-890d-9dc88e162ac5 req-3838b8f1-1699-4820-a2af-919f6197f17e service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cf118336-8f96-4362-890d-9dc88e162ac5 req-3838b8f1-1699-4820-a2af-919f6197f17e service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cf118336-8f96-4362-890d-9dc88e162ac5 req-3838b8f1-1699-4820-a2af-919f6197f17e service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-cf118336-8f96-4362-890d-9dc88e162ac5 req-3838b8f1-1699-4820-a2af-919f6197f17e service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:25 user nova-compute[75993]: WARNING nova.compute.manager [req-cf118336-8f96-4362-890d-9dc88e162ac5 req-3838b8f1-1699-4820-a2af-919f6197f17e service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received unexpected event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with vm_state building and task_state spawning.
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:51:25 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Instance spawned successfully.
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:25 user nova-compute[75993]: INFO nova.compute.manager [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Took 7.11 seconds to spawn the instance on the hypervisor.
Nov 08 21:51:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:51:26 user nova-compute[75993]: INFO nova.compute.manager [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Took 7.92 seconds to build instance.
Nov 08 21:51:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-72ee5259-6255-40de-af00-550d81161e0f tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.017s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:51:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:32 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:51:32 user nova-compute[75993]: INFO nova.compute.claims [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Claim successful on node user
Nov 08 21:51:32 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:51:32 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:51:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:51:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:51:32 user nova-compute[75993]: DEBUG nova.network.neutron [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:51:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:51:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG nova.policy [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78965be8230646288b7fc0443c3f4f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1547c59f8e4d85ad6f650b01243357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:51:33 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Creating image(s)
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "/opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "/opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "/opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.210s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.241s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk 1073741824" returned: 0 in 0.076s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.221s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Checking if we can resize image /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:51:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Successfully created port: 74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Cannot resize image /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Ensure instance console log exists: /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Successfully updated port: 74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "refresh_cache-95f8efd2-7c61-49b3-9e7d-ec97a4d22615" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquired lock "refresh_cache-95f8efd2-7c61-49b3-9e7d-ec97a4d22615" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-50ca8ffe-637c-4c03-93f5-f6fda9526d9d req-2376295d-5f94-4885-943c-4ebef97ce04e service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Received event network-changed-74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-50ca8ffe-637c-4c03-93f5-f6fda9526d9d req-2376295d-5f94-4885-943c-4ebef97ce04e service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Refreshing instance network info cache due to event network-changed-74dd16d2-b674-4372-a9a0-88b46af2c028. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-50ca8ffe-637c-4c03-93f5-f6fda9526d9d req-2376295d-5f94-4885-943c-4ebef97ce04e service nova] Acquiring lock "refresh_cache-95f8efd2-7c61-49b3-9e7d-ec97a4d22615" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Updating instance_info_cache with network_info: [{"id": "74dd16d2-b674-4372-a9a0-88b46af2c028", "address": "fa:16:3e:f2:19:50", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74dd16d2-b6", "ovs_interfaceid": "74dd16d2-b674-4372-a9a0-88b46af2c028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Releasing lock "refresh_cache-95f8efd2-7c61-49b3-9e7d-ec97a4d22615" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Instance network_info: |[{"id": "74dd16d2-b674-4372-a9a0-88b46af2c028", "address": "fa:16:3e:f2:19:50", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74dd16d2-b6", "ovs_interfaceid": "74dd16d2-b674-4372-a9a0-88b46af2c028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-50ca8ffe-637c-4c03-93f5-f6fda9526d9d req-2376295d-5f94-4885-943c-4ebef97ce04e service nova] Acquired lock "refresh_cache-95f8efd2-7c61-49b3-9e7d-ec97a4d22615" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-50ca8ffe-637c-4c03-93f5-f6fda9526d9d req-2376295d-5f94-4885-943c-4ebef97ce04e service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Refreshing network info cache for port 74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:51:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Start _get_guest_xml network_info=[{"id": "74dd16d2-b674-4372-a9a0-88b46af2c028", "address": "fa:16:3e:f2:19:50", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74dd16d2-b6", "ovs_interfaceid": "74dd16d2-b674-4372-a9a0-88b46af2c028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:51:34 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:51:34 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-154014429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-154014429',id=31,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-p8oun400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:51:33Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=95f8efd2-7c61-49b3-9e7d-ec97a4d22615,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74dd16d2-b674-4372-a9a0-88b46af2c028", "address": "fa:16:3e:f2:19:50", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74dd16d2-b6", "ovs_interfaceid": "74dd16d2-b674-4372-a9a0-88b46af2c028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "74dd16d2-b674-4372-a9a0-88b46af2c028", "address": "fa:16:3e:f2:19:50", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74dd16d2-b6", "ovs_interfaceid": "74dd16d2-b674-4372-a9a0-88b46af2c028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:50,bridge_name='br-int',has_traffic_filtering=True,id=74dd16d2-b674-4372-a9a0-88b46af2c028,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74dd16d2-b6') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'pci_devices' on Instance uuid 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:51:35 user nova-compute[75993]:   <uuid>95f8efd2-7c61-49b3-9e7d-ec97a4d22615</uuid>
Nov 08 21:51:35 user nova-compute[75993]:   <name>instance-0000001f</name>
Nov 08 21:51:35 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:51:35 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:51:35 user nova-compute[75993]:   <metadata>
Nov 08 21:51:35 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:51:35 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:51:35 user nova-compute[75993]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-154014429</nova:name>
Nov 08 21:51:35 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:51:35</nova:creationTime>
Nov 08 21:51:35 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:51:35 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:51:35 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:51:35 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:51:35 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:51:35 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:51:35 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:51:35 user nova-compute[75993]:       <nova:owner>
Nov 08 21:51:35 user nova-compute[75993]:         <nova:user uuid="78965be8230646288b7fc0443c3f4f6c">tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member</nova:user>
Nov 08 21:51:35 user nova-compute[75993]:         <nova:project uuid="fb1547c59f8e4d85ad6f650b01243357">tempest-ServerBootFromVolumeStableRescueTest-571934265</nova:project>
Nov 08 21:51:35 user nova-compute[75993]:       </nova:owner>
Nov 08 21:51:35 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:51:35 user nova-compute[75993]:       <nova:ports>
Nov 08 21:51:35 user nova-compute[75993]:         <nova:port uuid="74dd16d2-b674-4372-a9a0-88b46af2c028">
Nov 08 21:51:35 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 08 21:51:35 user nova-compute[75993]:         </nova:port>
Nov 08 21:51:35 user nova-compute[75993]:       </nova:ports>
Nov 08 21:51:35 user nova-compute[75993]:     </nova:instance>
Nov 08 21:51:35 user nova-compute[75993]:   </metadata>
Nov 08 21:51:35 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:51:35 user nova-compute[75993]:     <system>
Nov 08 21:51:35 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:51:35 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:51:35 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:51:35 user nova-compute[75993]:       <entry name="serial">95f8efd2-7c61-49b3-9e7d-ec97a4d22615</entry>
Nov 08 21:51:35 user nova-compute[75993]:       <entry name="uuid">95f8efd2-7c61-49b3-9e7d-ec97a4d22615</entry>
Nov 08 21:51:35 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:51:35 user nova-compute[75993]:     </system>
Nov 08 21:51:35 user nova-compute[75993]:   </sysinfo>
Nov 08 21:51:35 user nova-compute[75993]:   <os>
Nov 08 21:51:35 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:51:35 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:51:35 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:51:35 user nova-compute[75993]:   </os>
Nov 08 21:51:35 user nova-compute[75993]:   <features>
Nov 08 21:51:35 user nova-compute[75993]:     <acpi/>
Nov 08 21:51:35 user nova-compute[75993]:     <apic/>
Nov 08 21:51:35 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:51:35 user nova-compute[75993]:   </features>
Nov 08 21:51:35 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:51:35 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:51:35 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:51:35 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:51:35 user nova-compute[75993]:   </clock>
Nov 08 21:51:35 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:51:35 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:51:35 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:51:35 user nova-compute[75993]:   </cpu>
Nov 08 21:51:35 user nova-compute[75993]:   <devices>
Nov 08 21:51:35 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:51:35 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:51:35 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk"/>
Nov 08 21:51:35 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:51:35 user nova-compute[75993]:     </disk>
Nov 08 21:51:35 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:51:35 user nova-compute[75993]:       <mac address="fa:16:3e:f2:19:50"/>
Nov 08 21:51:35 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:51:35 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:51:35 user nova-compute[75993]:       <target dev="tap74dd16d2-b6"/>
Nov 08 21:51:35 user nova-compute[75993]:     </interface>
Nov 08 21:51:35 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:51:35 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/console.log" append="off"/>
Nov 08 21:51:35 user nova-compute[75993]:     </serial>
Nov 08 21:51:35 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:51:35 user nova-compute[75993]:     <video>
Nov 08 21:51:35 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:51:35 user nova-compute[75993]:     </video>
Nov 08 21:51:35 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:51:35 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:51:35 user nova-compute[75993]:     </rng>
Nov 08 21:51:35 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:51:35 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:51:35 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:51:35 user nova-compute[75993]:     </memballoon>
Nov 08 21:51:35 user nova-compute[75993]:   </devices>
Nov 08 21:51:35 user nova-compute[75993]: </domain>
Nov 08 21:51:35 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-154014429',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-154014429',id=31,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-p8oun400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:51:33Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=95f8efd2-7c61-49b3-9e7d-ec97a4d22615,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74dd16d2-b674-4372-a9a0-88b46af2c028", "address": "fa:16:3e:f2:19:50", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74dd16d2-b6", "ovs_interfaceid": "74dd16d2-b674-4372-a9a0-88b46af2c028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "74dd16d2-b674-4372-a9a0-88b46af2c028", "address": "fa:16:3e:f2:19:50", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74dd16d2-b6", "ovs_interfaceid": "74dd16d2-b674-4372-a9a0-88b46af2c028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:50,bridge_name='br-int',has_traffic_filtering=True,id=74dd16d2-b674-4372-a9a0-88b46af2c028,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74dd16d2-b6') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG os_vif [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:50,bridge_name='br-int',has_traffic_filtering=True,id=74dd16d2-b674-4372-a9a0-88b46af2c028,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74dd16d2-b6') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f331898d-67da-5237-88e8-7c15d430dd29', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74dd16d2-b6, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74dd16d2-b6, col_values=(('qos', UUID('5b61d3d2-6e2f-42b3-a2b4-eb6c9218e72c')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74dd16d2-b6, col_values=(('external_ids', {'iface-id': '74dd16d2-b674-4372-a9a0-88b46af2c028', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:19:50', 'vm-uuid': '95f8efd2-7c61-49b3-9e7d-ec97a4d22615'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:35 user nova-compute[75993]: INFO os_vif [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:19:50,bridge_name='br-int',has_traffic_filtering=True,id=74dd16d2-b674-4372-a9a0-88b46af2c028,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74dd16d2-b6')
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No VIF found with MAC fa:16:3e:f2:19:50, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.network.neutron [req-50ca8ffe-637c-4c03-93f5-f6fda9526d9d req-2376295d-5f94-4885-943c-4ebef97ce04e service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Updated VIF entry in instance network info cache for port 74dd16d2-b674-4372-a9a0-88b46af2c028. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG nova.network.neutron [req-50ca8ffe-637c-4c03-93f5-f6fda9526d9d req-2376295d-5f94-4885-943c-4ebef97ce04e service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Updating instance_info_cache with network_info: [{"id": "74dd16d2-b674-4372-a9a0-88b46af2c028", "address": "fa:16:3e:f2:19:50", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74dd16d2-b6", "ovs_interfaceid": "74dd16d2-b674-4372-a9a0-88b46af2c028", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:51:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-50ca8ffe-637c-4c03-93f5-f6fda9526d9d req-2376295d-5f94-4885-943c-4ebef97ce04e service nova] Releasing lock "refresh_cache-95f8efd2-7c61-49b3-9e7d-ec97a4d22615" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:51:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-5e29e789-c8b7-4bce-9647-254ee4062f20 req-714ea6a9-9207-4ad5-805f-a58aeeb7792b service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Received event network-vif-plugged-74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5e29e789-c8b7-4bce-9647-254ee4062f20 req-714ea6a9-9207-4ad5-805f-a58aeeb7792b service nova] Acquiring lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5e29e789-c8b7-4bce-9647-254ee4062f20 req-714ea6a9-9207-4ad5-805f-a58aeeb7792b service nova] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5e29e789-c8b7-4bce-9647-254ee4062f20 req-714ea6a9-9207-4ad5-805f-a58aeeb7792b service nova] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-5e29e789-c8b7-4bce-9647-254ee4062f20 req-714ea6a9-9207-4ad5-805f-a58aeeb7792b service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] No waiting events found dispatching network-vif-plugged-74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:37 user nova-compute[75993]: WARNING nova.compute.manager [req-5e29e789-c8b7-4bce-9647-254ee4062f20 req-714ea6a9-9207-4ad5-805f-a58aeeb7792b service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Received unexpected event network-vif-plugged-74dd16d2-b674-4372-a9a0-88b46af2c028 for instance with vm_state building and task_state spawning.
Nov 08 21:51:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-3996af20-293d-422c-a128-b3e1473c06eb req-3ffa4f9d-1052-4614-b95b-addd683458c3 service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Received event network-vif-plugged-74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3996af20-293d-422c-a128-b3e1473c06eb req-3ffa4f9d-1052-4614-b95b-addd683458c3 service nova] Acquiring lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3996af20-293d-422c-a128-b3e1473c06eb req-3ffa4f9d-1052-4614-b95b-addd683458c3 service nova] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3996af20-293d-422c-a128-b3e1473c06eb req-3ffa4f9d-1052-4614-b95b-addd683458c3 service nova] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-3996af20-293d-422c-a128-b3e1473c06eb req-3ffa4f9d-1052-4614-b95b-addd683458c3 service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] No waiting events found dispatching network-vif-plugged-74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:39 user nova-compute[75993]: WARNING nova.compute.manager [req-3996af20-293d-422c-a128-b3e1473c06eb req-3ffa4f9d-1052-4614-b95b-addd683458c3 service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Received unexpected event network-vif-plugged-74dd16d2-b674-4372-a9a0-88b46af2c028 for instance with vm_state building and task_state spawning.
Nov 08 21:51:39 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Instance spawned successfully.
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:51:39 user nova-compute[75993]: INFO nova.compute.manager [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 08 21:51:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:51:39 user nova-compute[75993]: INFO nova.compute.manager [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Took 7.01 seconds to build instance.
Nov 08 21:51:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3cb8cd47-e43e-4549-856b-aa71291984c7 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.179s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:46 user nova-compute[75993]: INFO nova.compute.manager [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Terminating instance
Nov 08 21:51:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:51:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-6633f85c-e04c-4361-a857-178448d604dc req-07700cb0-299f-49e5-832c-541fcd7d9089 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-vif-unplugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6633f85c-e04c-4361-a857-178448d604dc req-07700cb0-299f-49e5-832c-541fcd7d9089 service nova] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6633f85c-e04c-4361-a857-178448d604dc req-07700cb0-299f-49e5-832c-541fcd7d9089 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6633f85c-e04c-4361-a857-178448d604dc req-07700cb0-299f-49e5-832c-541fcd7d9089 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-6633f85c-e04c-4361-a857-178448d604dc req-07700cb0-299f-49e5-832c-541fcd7d9089 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] No waiting events found dispatching network-vif-unplugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-6633f85c-e04c-4361-a857-178448d604dc req-07700cb0-299f-49e5-832c-541fcd7d9089 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-vif-unplugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Instance destroyed successfully.
Nov 08 21:51:47 user nova-compute[75993]: DEBUG nova.objects.instance [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lazy-loading 'resources' on Instance uuid f047433f-eaaa-4b81-b97c-6aa2f1cecff0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:46:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1192898756',display_name='tempest-AttachVolumeTestJSON-server-1192898756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1192898756',id=27,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCavfzPdyZR0hC9Dtk00SIVzO7wofuBGow/+mTLml1kA8wrk1QDXNFyc0KzGE5gse5ERSayXaNRDQRkCNOo18zZ/TG7chvHeIQQmXYYm0fNhLV12ZkrQJMUDZ1BOGH9B8A==',key_name='tempest-keypair-948748209',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:46:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00def573657242f289160a6a74dd8ad3',ramdisk_id='',reservation_id='r-n5af4wwq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1483084463',owner_user_name='tempest-AttachVolumeTestJSON-1483084463-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:46:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9276d87f95734c47897fba9ea4fe2d94',uuid=f047433f-eaaa-4b81-b97c-6aa2f1cecff0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "address": "fa:16:3e:b1:ee:3f", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc7f32b-90", "ovs_interfaceid": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converting VIF {"id": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "address": "fa:16:3e:b1:ee:3f", "network": {"id": "e151e0c6-27a6-4289-afec-a71a7753f001", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1820284631-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00def573657242f289160a6a74dd8ad3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc7f32b-90", "ovs_interfaceid": "6cc7f32b-9074-4af0-a9c8-6a8a85fe166b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:ee:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cc7f32b-9074-4af0-a9c8-6a8a85fe166b,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc7f32b-90') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG os_vif [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:ee:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cc7f32b-9074-4af0-a9c8-6a8a85fe166b,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc7f32b-90') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cc7f32b-90, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b783a3a-36b1-4171-941f-1766d979c657) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:47 user nova-compute[75993]: INFO os_vif [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:ee:3f,bridge_name='br-int',has_traffic_filtering=True,id=6cc7f32b-9074-4af0-a9c8-6a8a85fe166b,network=Network(e151e0c6-27a6-4289-afec-a71a7753f001),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc7f32b-90')
Nov 08 21:51:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Deleting instance files /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0_del
Nov 08 21:51:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Deletion of /opt/stack/data/nova/instances/f047433f-eaaa-4b81-b97c-6aa2f1cecff0_del complete
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:47 user nova-compute[75993]: INFO nova.compute.manager [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 08 21:51:47 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:48 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:51:48 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Took 1.27 seconds to deallocate network for instance.
Nov 08 21:51:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] No waiting events found dispatching network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:49 user nova-compute[75993]: WARNING nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received unexpected event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b for instance with vm_state deleted and task_state None.
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] No waiting events found dispatching network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:49 user nova-compute[75993]: WARNING nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received unexpected event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b for instance with vm_state deleted and task_state None.
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] No waiting events found dispatching network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:49 user nova-compute[75993]: WARNING nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received unexpected event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b for instance with vm_state deleted and task_state None.
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-vif-unplugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] No waiting events found dispatching network-vif-unplugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:49 user nova-compute[75993]: WARNING nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received unexpected event network-vif-unplugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b for instance with vm_state deleted and task_state None.
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Acquiring lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] No waiting events found dispatching network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:49 user nova-compute[75993]: WARNING nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received unexpected event network-vif-plugged-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b for instance with vm_state deleted and task_state None.
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-78f1bbe8-8739-4a53-b217-afe253973e02 req-bd1876a3-498c-4590-8903-7bbc2512cd57 service nova] [instance: f047433f-eaaa-4b81-b97c-6aa2f1cecff0] Received event network-vif-deleted-6cc7f32b-9074-4af0-a9c8-6a8a85fe166b {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:49 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Deleted allocations for instance f047433f-eaaa-4b81-b97c-6aa2f1cecff0
Nov 08 21:51:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-401bd26d-2324-46e7-8a37-1843048caa48 tempest-AttachVolumeTestJSON-1483084463 tempest-AttachVolumeTestJSON-1483084463-project-member] Lock "f047433f-eaaa-4b81-b97c-6aa2f1cecff0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.765s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "adef30df-4254-4133-9db2-4c7708cd1996" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:55 user nova-compute[75993]: INFO nova.compute.manager [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Terminating instance
Nov 08 21:51:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-e83b0c1a-c8f8-4b23-b825-ea1d9f2125ab req-3556b59c-9977-49f0-a428-c83da5e31441 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e83b0c1a-c8f8-4b23-b825-ea1d9f2125ab req-3556b59c-9977-49f0-a428-c83da5e31441 service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e83b0c1a-c8f8-4b23-b825-ea1d9f2125ab req-3556b59c-9977-49f0-a428-c83da5e31441 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e83b0c1a-c8f8-4b23-b825-ea1d9f2125ab req-3556b59c-9977-49f0-a428-c83da5e31441 service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-e83b0c1a-c8f8-4b23-b825-ea1d9f2125ab req-3556b59c-9977-49f0-a428-c83da5e31441 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-e83b0c1a-c8f8-4b23-b825-ea1d9f2125ab req-3556b59c-9977-49f0-a428-c83da5e31441 service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-unplugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Instance destroyed successfully.
Nov 08 21:51:56 user nova-compute[75993]: DEBUG nova.objects.instance [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lazy-loading 'resources' on Instance uuid adef30df-4254-4133-9db2-4c7708cd1996 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-55830472',display_name='tempest-ServerRescueNegativeTestJSON-server-55830472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-55830472',id=1,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:38:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3b0aa87ce49949be27025c497a432',ramdisk_id='',reservation_id='r-30861mpj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1699992008',owner_user_name='tempest-ServerRescueNegativeTestJSON-1699992008-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:40:45Z,user_data=None,user_id='37e02c3f49f1467498623a47a979a65d',uuid=adef30df-4254-4133-9db2-4c7708cd1996,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converting VIF {"id": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "address": "fa:16:3e:85:c5:88", "network": {"id": "c4e10314-31cb-4567-865d-c6ee1c01f7ac", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1802606201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3b0aa87ce49949be27025c497a432", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ee949d-fc", "ovs_interfaceid": "b8ee949d-fc2c-4df0-811f-eca62af20a5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:c5:88,bridge_name='br-int',has_traffic_filtering=True,id=b8ee949d-fc2c-4df0-811f-eca62af20a5c,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ee949d-fc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG os_vif [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:c5:88,bridge_name='br-int',has_traffic_filtering=True,id=b8ee949d-fc2c-4df0-811f-eca62af20a5c,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ee949d-fc') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8ee949d-fc, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f91c0e91-bd0c-414d-ad07-cdd2a3b5317a) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:51:56 user nova-compute[75993]: INFO os_vif [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:c5:88,bridge_name='br-int',has_traffic_filtering=True,id=b8ee949d-fc2c-4df0-811f-eca62af20a5c,network=Network(c4e10314-31cb-4567-865d-c6ee1c01f7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ee949d-fc')
Nov 08 21:51:56 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Deleting instance files /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996_del
Nov 08 21:51:56 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Deletion of /opt/stack/data/nova/instances/adef30df-4254-4133-9db2-4c7708cd1996_del complete
Nov 08 21:51:56 user nova-compute[75993]: INFO nova.compute.manager [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Took 0.78 seconds to destroy the instance on the hypervisor.
Nov 08 21:51:56 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:51:56 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: adef30df-4254-4133-9db2-4c7708cd1996] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:51:57 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:51:57 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Took 0.70 seconds to deallocate network for instance.
Nov 08 21:51:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:57 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:51:57 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:51:57 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:51:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:57 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Deleted allocations for instance adef30df-4254-4133-9db2-4c7708cd1996
Nov 08 21:51:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8962433f-4ff0-4642-ae8a-6a98c3196ed3 tempest-ServerRescueNegativeTestJSON-1699992008 tempest-ServerRescueNegativeTestJSON-1699992008-project-member] Lock "adef30df-4254-4133-9db2-4c7708cd1996" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-ff15936e-a1ea-44ff-9d1c-8d98ba07c660 req-0f94479a-84b2-45eb-bd04-4221f47712af service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:51:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ff15936e-a1ea-44ff-9d1c-8d98ba07c660 req-0f94479a-84b2-45eb-bd04-4221f47712af service nova] Acquiring lock "adef30df-4254-4133-9db2-4c7708cd1996-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:51:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ff15936e-a1ea-44ff-9d1c-8d98ba07c660 req-0f94479a-84b2-45eb-bd04-4221f47712af service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:51:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ff15936e-a1ea-44ff-9d1c-8d98ba07c660 req-0f94479a-84b2-45eb-bd04-4221f47712af service nova] Lock "adef30df-4254-4133-9db2-4c7708cd1996-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:51:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-ff15936e-a1ea-44ff-9d1c-8d98ba07c660 req-0f94479a-84b2-45eb-bd04-4221f47712af service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] No waiting events found dispatching network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:51:58 user nova-compute[75993]: WARNING nova.compute.manager [req-ff15936e-a1ea-44ff-9d1c-8d98ba07c660 req-0f94479a-84b2-45eb-bd04-4221f47712af service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received unexpected event network-vif-plugged-b8ee949d-fc2c-4df0-811f-eca62af20a5c for instance with vm_state deleted and task_state None.
Nov 08 21:51:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-ff15936e-a1ea-44ff-9d1c-8d98ba07c660 req-0f94479a-84b2-45eb-bd04-4221f47712af service nova] [instance: adef30df-4254-4133-9db2-4c7708cd1996] Received event network-vif-deleted-b8ee949d-fc2c-4df0-811f-eca62af20a5c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:52:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:01 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:52:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:03 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:52:03 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:52:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:52:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:52:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:52:03 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:52:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:52:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:06 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:52:06 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7840MB free_disk=25.054359436035156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 41c2971c-5db5-4951-8adf-ffbe063498dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:52:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:52:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:52:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:52:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:52:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:52:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:52:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updating instance_info_cache with network_info: [{"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:52:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:52:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:52:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:52:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:52:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:52:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:52:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:52:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:52:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:52:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:52:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 21:52:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:52:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:52:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-2f291423-f228-4224-9451-8ae3dda5cbc4 req-a72225f4-28db-4af0-96b4-7b55930fa3bf service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Received event network-changed-ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:52:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-2f291423-f228-4224-9451-8ae3dda5cbc4 req-a72225f4-28db-4af0-96b4-7b55930fa3bf service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Refreshing instance network info cache due to event network-changed-ef176aaa-2d27-4798-a4c8-e522e717bca3. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:52:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2f291423-f228-4224-9451-8ae3dda5cbc4 req-a72225f4-28db-4af0-96b4-7b55930fa3bf service nova] Acquiring lock "refresh_cache-41c2971c-5db5-4951-8adf-ffbe063498dc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:52:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2f291423-f228-4224-9451-8ae3dda5cbc4 req-a72225f4-28db-4af0-96b4-7b55930fa3bf service nova] Acquired lock "refresh_cache-41c2971c-5db5-4951-8adf-ffbe063498dc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:52:39 user nova-compute[75993]: DEBUG nova.network.neutron [req-2f291423-f228-4224-9451-8ae3dda5cbc4 req-a72225f4-28db-4af0-96b4-7b55930fa3bf service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Refreshing network info cache for port ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "41c2971c-5db5-4951-8adf-ffbe063498dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG nova.objects.instance [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lazy-loading 'flavor' on Instance uuid 41c2971c-5db5-4951-8adf-ffbe063498dc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:52:40 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Ignoring supplied device name: /dev/vdb
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG nova.network.neutron [req-2f291423-f228-4224-9451-8ae3dda5cbc4 req-a72225f4-28db-4af0-96b4-7b55930fa3bf service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Updated VIF entry in instance network info cache for port ef176aaa-2d27-4798-a4c8-e522e717bca3. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG nova.network.neutron [req-2f291423-f228-4224-9451-8ae3dda5cbc4 req-a72225f4-28db-4af0-96b4-7b55930fa3bf service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Updating instance_info_cache with network_info: [{"id": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "address": "fa:16:3e:34:e9:65", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef176aaa-2d", "ovs_interfaceid": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2f291423-f228-4224-9451-8ae3dda5cbc4 req-a72225f4-28db-4af0-96b4-7b55930fa3bf service nova] Releasing lock "refresh_cache-41c2971c-5db5-4951-8adf-ffbe063498dc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "41c2971c-5db5-4951-8adf-ffbe063498dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:52:40 user nova-compute[75993]: INFO nova.compute.manager [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Attaching volume 9e04aa30-b313-42fd-9074-a61176aaef4c to /dev/vdb
Nov 08 21:52:40 user nova-compute[75993]: DEBUG os_brick.utils [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e0006-c6d0-4a49-af55-f5d68bcad9d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6c8259-2be6-4a52-b1ed-036499b78889]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[935d710e-b719-4da4-b17c-adc15677ff11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b889c64-db85-4378-8bef-ccbf3fab7578]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:52:40 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:52:40 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[61774a45-9f24-4725-ac81-fa73582b5574]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG os_brick.utils [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:52:40 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Updating existing volume attachment record: 27a0e8c5-ecd8-4ced-ba57-60e87d0a9fb8 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:52:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:52:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:52:45 user nova-compute[75993]: INFO nova.compute.manager [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Detaching volume cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee
Nov 08 21:52:45 user nova-compute[75993]: INFO nova.virt.block_device [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Attempting to driver detach volume cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee from mountpoint /dev/vdb
Nov 08 21:52:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Attempting to detach device vdb from instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:52:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:52:45 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:52:45 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:52:45 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:52:45 user nova-compute[75993]:   <serial>cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee</serial>
Nov 08 21:52:45 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 21:52:45 user nova-compute[75993]: </disk>
Nov 08 21:52:45 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:52:45 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully detached device vdb from instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f from the persistent domain config.
Nov 08 21:52:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:52:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:52:45 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:52:45 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:52:45 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:52:45 user nova-compute[75993]:   <serial>cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee</serial>
Nov 08 21:52:45 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 21:52:45 user nova-compute[75993]: </disk>
Nov 08 21:52:45 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:52:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:52:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:52:57 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:53:01 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:53:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:03 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:53:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:53:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:53:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:53:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:53:04 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:53:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f is timed out.
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully detached device vdb from instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f from the live domain config.
Nov 08 21:53:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XenfiCxU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:53:05 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[042c5faa-48b3-4d11-8a29-d5344a67e937]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:53:05 user nova-compute[75993]: No targets found.
Nov 08 21:53:05 user nova-compute[75993]: iSNS:
Nov 08 21:53:05 user nova-compute[75993]: No targets found.
Nov 08 21:53:05 user nova-compute[75993]: STATIC:
Nov 08 21:53:05 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:53:05 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:53:05 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:53:05 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee
Nov 08 21:53:05 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:53:05 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:53:05 user nova-compute[75993]: FIRMWARE:
Nov 08 21:53:05 user nova-compute[75993]: No targets found.
Nov 08 21:53:05 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:53:05 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:53:05 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3be22e5-b34b-40dd-967d-9b0a9219c6a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84c321e-07b1-4358-bb41-6c921c7ad5b3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:53:05 user nova-compute[75993]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)
Nov 08 21:53:05 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:53:05 user nova-compute[75993]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee (non-flash)
Nov 08 21:53:05 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544d60f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9428a2ed-1362-4a0d-8046-8e6317417734]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e88070-9b5d-4e22-82b0-de3de0b1ac4a]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80b9207-2302-404d-b1eb-d7a78f228e4b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.064s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d6c73d-fc29-408c-8625-4b9bd9e76c97]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38ea0c1-5783-4ca6-bd6f-672c3fe2debd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:53:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbf8f1c-4206-40e7-a171-70ca9b0a5e9d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260]
Nov 08 21:53:06 user nova-compute[75993]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee, portal: 172.16.0.220,3260] successful.
Nov 08 21:53:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd7c9efd-d962-47e8-b4fe-2c1e4183f4ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22c7171-8a8f-486e-b1ee-b3b9e565c14d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== disconnect_volume: return (440ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egkiBOxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:53:06 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:53:06 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:53:06 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbd21da-5abe-4aec-a46e-91fb2f39af88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:53:06 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[48dae053-d798-495c-b3e7-30de38987e1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c] added
Nov 08 21:53:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c199a9-7af9-4989-89d9-0c2296638ee5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0046d81-8091-477b-b22a-6384841db6c5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egkiBOxL {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v egkiBOxL" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[413b9a59-e3fd-4930-81f1-e3aa9f52b977]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'egkiBOxL'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[60198292-fe83-45a0-8041-7f5e2ffb042d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c773be5-4303-4614-8c82-5052c98f22e4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:53:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:53:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f45d56-cb94-459b-ad4b-df5f9ffbfd70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c, portal: 172.16.0.220,3260]
Nov 08 21:53:06 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c, portal: 172.16.0.220,3260] successful.
Nov 08 21:53:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86b4d01-1426-45f0-b377-fafafc592037]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3d1efe-268f-4e25-aa15-f33a7a387ad2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:53:06 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:53:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:53:06 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:53:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7be796-0c2d-4a53-9284-f911a7d113c0]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egkiBOxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'flavor' on Instance uuid f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ad2b05cb-c926-483d-8355-79d704302ff4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.142s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:07 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:53:07 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8087MB free_disk=25.049461364746094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] <== connect_volume: return (1478ms) {'type': 'block', 'scsi_wwn': '26539626237343836', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539626237343836', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.objects.instance [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lazy-loading 'flavor' on Instance uuid 41c2971c-5db5-4951-8adf-ffbe063498dc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:53:07 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:53:07 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:53:07 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:53:07 user nova-compute[75993]:   <serial>9e04aa30-b313-42fd-9074-a61176aaef4c</serial>
Nov 08 21:53:07 user nova-compute[75993]: </disk>
Nov 08 21:53:07 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 41c2971c-5db5-4951-8adf-ffbe063498dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:53:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:53:08 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:53:08 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:53:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:53:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:53:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:53:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:53:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] No VIF found with MAC fa:16:3e:34:e9:65, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:53:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1dc03719-985d-4e93-8b6b-94ead3f72391 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.982s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:53:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:53:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:53:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:53:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:53:10 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:53:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Updating instance_info_cache with network_info: [{"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:53:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:53:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:53:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:53:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:53:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:53:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:53:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:12 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG nova.objects.instance [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'flavor' on Instance uuid 42555213-8dfd-4b93-8827-2b72ae3ca2e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:53:16 user nova-compute[75993]: INFO nova.compute.manager [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Attaching volume 16576d6c-8af1-4e46-b05c-44547d841676 to /dev/vdb
Nov 08 21:53:16 user nova-compute[75993]: DEBUG os_brick.utils [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[33851086-38e9-4575-a0aa-573599ae57f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[779292b3-272a-4163-aff7-b155018ecc47]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1a5796-a46a-42ad-a07e-5528680b88df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ac4446-6100-4188-8cfd-78698a68f3a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:53:16 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:53:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[251e554d-3f50-4a88-9f0d-12ee2da0ba64]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG os_brick.utils [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updating existing volume attachment record: 0f33f0ca-5cbc-43dd-924d-d74bf25a3ac0 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:53:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:53:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:53:23 user nova-compute[75993]: INFO nova.compute.manager [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] instance snapshotting
Nov 08 21:53:23 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Beginning live snapshot process
Nov 08 21:53:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json -f qcow2 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json -f qcow2 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqdp5j3dq/af37f1fd81db4ec2ac1ba61599261905.delta 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqdp5j3dq/af37f1fd81db4ec2ac1ba61599261905.delta 1073741824" returned: 0 in 0.103s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:24 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 08 21:53:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:53:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75993) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 08 21:53:25 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 08 21:53:25 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:53:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqdp5j3dq/af37f1fd81db4ec2ac1ba61599261905.delta /opt/stack/data/nova/instances/snapshots/tmpqdp5j3dq/af37f1fd81db4ec2ac1ba61599261905 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:53:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqdp5j3dq/af37f1fd81db4ec2ac1ba61599261905.delta /opt/stack/data/nova/instances/snapshots/tmpqdp5j3dq/af37f1fd81db4ec2ac1ba61599261905" returned: 0 in 0.781s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Snapshot extracted, beginning image upload
Nov 08 21:53:29 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Snapshot image upload complete
Nov 08 21:53:29 user nova-compute[75993]: INFO nova.compute.manager [None req-2f5ddf98-d1e8-49f2-982e-7412fb315ce1 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Took 5.98 seconds to snapshot the instance on the hypervisor.
Nov 08 21:53:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:53:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:53:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:53:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:53:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:53:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:53:35 user nova-compute[75993]: INFO nova.compute.manager [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Terminating instance
Nov 08 21:53:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:53:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-f581999c-78fe-481a-9588-a683f320df59 req-4d87668d-233d-494a-a256-773712ca1cb7 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-vif-unplugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f581999c-78fe-481a-9588-a683f320df59 req-4d87668d-233d-494a-a256-773712ca1cb7 service nova] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f581999c-78fe-481a-9588-a683f320df59 req-4d87668d-233d-494a-a256-773712ca1cb7 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f581999c-78fe-481a-9588-a683f320df59 req-4d87668d-233d-494a-a256-773712ca1cb7 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-f581999c-78fe-481a-9588-a683f320df59 req-4d87668d-233d-494a-a256-773712ca1cb7 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] No waiting events found dispatching network-vif-unplugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-f581999c-78fe-481a-9588-a683f320df59 req-4d87668d-233d-494a-a256-773712ca1cb7 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-vif-unplugged-89871e15-aec8-4d15-8672-313d84c98870 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Instance destroyed successfully.
Nov 08 21:53:36 user nova-compute[75993]: DEBUG nova.objects.instance [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'resources' on Instance uuid f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T21:46:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1222137561',display_name='tempest-ServerActionsTestOtherA-server-871506730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1222137561',id=28,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEx16iEb6CeFHI0TasVxtYtLjeV3PPjbyaq7k//aB1Zq4ApiAjvF8kHWO6ru0wGEM9NttEZOQsBaV9WtV6vPGjv/2ZDyxWsE6IzcbI1GOMvT4gB4T5MAXhahrl24BHfVYQ==',key_name='tempest-keypair-1858342574',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:50:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-laco4f50',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:50:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "89871e15-aec8-4d15-8672-313d84c98870", "address": "fa:16:3e:16:21:b5", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89871e15-ae", "ovs_interfaceid": "89871e15-aec8-4d15-8672-313d84c98870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG os_vif [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89871e15-ae, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f07c7e9d-e975-4157-be66-da4041727c25) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:36 user nova-compute[75993]: INFO os_vif [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:21:b5,bridge_name='br-int',has_traffic_filtering=True,id=89871e15-aec8-4d15-8672-313d84c98870,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89871e15-ae')
Nov 08 21:53:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Deleting instance files /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f_del
Nov 08 21:53:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Deletion of /opt/stack/data/nova/instances/f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f_del complete
Nov 08 21:53:36 user nova-compute[75993]: INFO nova.compute.manager [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 08 21:53:36 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:53:36 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:53:37 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:53:37 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Took 0.99 seconds to deallocate network for instance.
Nov 08 21:53:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-93ea8e64-7787-46d6-80a3-d0421507d495 req-8cfa2fd1-8547-4e71-9ce6-b4ee4d97c721 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-vif-deleted-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:53:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:53:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:53:38 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:53:38 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:53:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:53:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-749e8097-08ba-47a7-b7e4-f45accd34519 req-e8afd0a6-6f89-4a82-96bd-bbd9a7f63499 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:53:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-749e8097-08ba-47a7-b7e4-f45accd34519 req-e8afd0a6-6f89-4a82-96bd-bbd9a7f63499 service nova] Acquiring lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:53:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-749e8097-08ba-47a7-b7e4-f45accd34519 req-e8afd0a6-6f89-4a82-96bd-bbd9a7f63499 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:53:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-749e8097-08ba-47a7-b7e4-f45accd34519 req-e8afd0a6-6f89-4a82-96bd-bbd9a7f63499 service nova] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:53:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-749e8097-08ba-47a7-b7e4-f45accd34519 req-e8afd0a6-6f89-4a82-96bd-bbd9a7f63499 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] No waiting events found dispatching network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:53:38 user nova-compute[75993]: WARNING nova.compute.manager [req-749e8097-08ba-47a7-b7e4-f45accd34519 req-e8afd0a6-6f89-4a82-96bd-bbd9a7f63499 service nova] [instance: f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f] Received unexpected event network-vif-plugged-89871e15-aec8-4d15-8672-313d84c98870 for instance with vm_state deleted and task_state None.
Nov 08 21:53:38 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Deleted allocations for instance f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f
Nov 08 21:53:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dc865a67-ae96-4946-8bd2-e9483b7efc54 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "f2bb5be8-8cdc-49c6-8684-acefdb5b5c7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.683s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:53:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBqjPKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:53:42 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:53:42 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:53:42 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a47a878-91c2-4e9c-b7d7-c1ed5dae900b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:53:42 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8946beee-8272-45ca-84f1-ac35318c3690]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676] added
Nov 08 21:53:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[242dbe3c-f560-4869-96d2-4f78e2481a7e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b67f112-85fc-4419-9087-25e796583d26]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBqjPKRT {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBqjPKRT" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[21050701-d89d-4535-9e6a-8a4e83f1b6b2]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FBqjPKRT'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbba96b8-0bc4-48d7-a1e6-b06621ed6b00]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[92247f1a-0815-4498-acb5-0b5d18c6c078]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:53:42 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:53:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:53:42 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:53:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7c4310-a0cf-4daa-a6ef-f63aca77bbd0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260]
Nov 08 21:53:42 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260] successful.
Nov 08 21:53:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[788ba5b4-0834-4795-89b4-4adb74f6532b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b0acb-f983-40d8-b9d0-b03b7356319f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:53:42 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:53:42 user nova-compute[75993]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:53:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:53:42 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:53:42 user nova-compute[75993]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:53:42 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ff207d-670b-4be3-a0d2-ff9d97b5376d]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:53:42 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBqjPKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:53:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:53:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23834636633646639', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:53:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834636633646639', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:53:43 user nova-compute[75993]: DEBUG nova.objects.instance [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'flavor' on Instance uuid 42555213-8dfd-4b93-8827-2b72ae3ca2e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:53:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 21:53:43 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:53:43 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 21:53:43 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:53:43 user nova-compute[75993]:   <serial>16576d6c-8af1-4e46-b05c-44547d841676</serial>
Nov 08 21:53:43 user nova-compute[75993]: </disk>
Nov 08 21:53:43 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 21:53:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:53:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:53:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] No VIF found with MAC fa:16:3e:19:82:5e, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:53:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-436ca16a-2bde-45ed-aae7-f12cae34d0e5 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.312s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:53:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:53:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 21:53:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:53:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 21:53:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:53:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:53:59 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:54:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-c3a3fbc7-7775-4d82-aa90-326aa19158f8 req-49d8eae7-49c9-4e3c-ae54-a0501d06735d service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-changed-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-c3a3fbc7-7775-4d82-aa90-326aa19158f8 req-49d8eae7-49c9-4e3c-ae54-a0501d06735d service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Refreshing instance network info cache due to event network-changed-5659f008-dda6-4153-b5fb-8cc33eba94ee. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:54:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c3a3fbc7-7775-4d82-aa90-326aa19158f8 req-49d8eae7-49c9-4e3c-ae54-a0501d06735d service nova] Acquiring lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:54:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c3a3fbc7-7775-4d82-aa90-326aa19158f8 req-49d8eae7-49c9-4e3c-ae54-a0501d06735d service nova] Acquired lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:54:00 user nova-compute[75993]: DEBUG nova.network.neutron [req-c3a3fbc7-7775-4d82-aa90-326aa19158f8 req-49d8eae7-49c9-4e3c-ae54-a0501d06735d service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Refreshing network info cache for port 5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:54:01 user nova-compute[75993]: DEBUG nova.network.neutron [req-c3a3fbc7-7775-4d82-aa90-326aa19158f8 req-49d8eae7-49c9-4e3c-ae54-a0501d06735d service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updated VIF entry in instance network info cache for port 5659f008-dda6-4153-b5fb-8cc33eba94ee. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:54:01 user nova-compute[75993]: DEBUG nova.network.neutron [req-c3a3fbc7-7775-4d82-aa90-326aa19158f8 req-49d8eae7-49c9-4e3c-ae54-a0501d06735d service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updating instance_info_cache with network_info: [{"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:54:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c3a3fbc7-7775-4d82-aa90-326aa19158f8 req-49d8eae7-49c9-4e3c-ae54-a0501d06735d service nova] Releasing lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:54:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:02 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:54:03 user nova-compute[75993]: DEBUG nova.compute.manager [req-8d16c516-6c92-408e-ae83-c9f942a38fa2 req-6ab09ce0-45c6-4d11-ab76-ddbef8100891 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-changed-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:03 user nova-compute[75993]: DEBUG nova.compute.manager [req-8d16c516-6c92-408e-ae83-c9f942a38fa2 req-6ab09ce0-45c6-4d11-ab76-ddbef8100891 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Refreshing instance network info cache due to event network-changed-5659f008-dda6-4153-b5fb-8cc33eba94ee. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:54:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8d16c516-6c92-408e-ae83-c9f942a38fa2 req-6ab09ce0-45c6-4d11-ab76-ddbef8100891 service nova] Acquiring lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:54:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8d16c516-6c92-408e-ae83-c9f942a38fa2 req-6ab09ce0-45c6-4d11-ab76-ddbef8100891 service nova] Acquired lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:54:03 user nova-compute[75993]: DEBUG nova.network.neutron [req-8d16c516-6c92-408e-ae83-c9f942a38fa2 req-6ab09ce0-45c6-4d11-ab76-ddbef8100891 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Refreshing network info cache for port 5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:54:03 user nova-compute[75993]: DEBUG nova.network.neutron [req-8d16c516-6c92-408e-ae83-c9f942a38fa2 req-6ab09ce0-45c6-4d11-ab76-ddbef8100891 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updated VIF entry in instance network info cache for port 5659f008-dda6-4153-b5fb-8cc33eba94ee. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:54:03 user nova-compute[75993]: DEBUG nova.network.neutron [req-8d16c516-6c92-408e-ae83-c9f942a38fa2 req-6ab09ce0-45c6-4d11-ab76-ddbef8100891 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updating instance_info_cache with network_info: [{"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:54:03 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8d16c516-6c92-408e-ae83-c9f942a38fa2 req-6ab09ce0-45c6-4d11-ab76-ddbef8100891 service nova] Releasing lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:54:05 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:54:05 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:54:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:05 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:54:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:54:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:54:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:54:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:08 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:54:08 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8233MB free_disk=24.99966049194336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 41c2971c-5db5-4951-8adf-ffbe063498dc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:54:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.398s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:54:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:54:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 21:54:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:54:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:54:10 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:54:10 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 1f2e921c-69cc-496c-9e19-561dcfd00a72 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:54:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Updating instance_info_cache with network_info: [{"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:54:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:54:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:54:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:54:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:54:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:54:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:54:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:12 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:54:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "41c2971c-5db5-4951-8adf-ffbe063498dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:14 user nova-compute[75993]: INFO nova.compute.manager [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Detaching volume 9e04aa30-b313-42fd-9074-a61176aaef4c
Nov 08 21:54:14 user nova-compute[75993]: INFO nova.virt.block_device [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Attempting to driver detach volume 9e04aa30-b313-42fd-9074-a61176aaef4c from mountpoint /dev/vdb
Nov 08 21:54:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Attempting to detach device vdb from instance 41c2971c-5db5-4951-8adf-ffbe063498dc from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:54:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:54:14 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:54:14 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:54:14 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:54:14 user nova-compute[75993]:   <serial>9e04aa30-b313-42fd-9074-a61176aaef4c</serial>
Nov 08 21:54:14 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:54:14 user nova-compute[75993]: </disk>
Nov 08 21:54:14 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:54:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "41c2971c-5db5-4951-8adf-ffbe063498dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Successfully detached device vdb from instance 41c2971c-5db5-4951-8adf-ffbe063498dc from the persistent domain config.
Nov 08 21:54:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 41c2971c-5db5-4951-8adf-ffbe063498dc from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:54:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:54:14 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:54:14 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 21:54:14 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:54:14 user nova-compute[75993]:   <serial>9e04aa30-b313-42fd-9074-a61176aaef4c</serial>
Nov 08 21:54:14 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 21:54:14 user nova-compute[75993]: </disk>
Nov 08 21:54:14 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:54:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 41c2971c-5db5-4951-8adf-ffbe063498dc {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:54:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:54:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:22 user nova-compute[75993]: INFO nova.compute.manager [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Rebooting instance
Nov 08 21:54:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:54:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquired lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:54:22 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updating instance_info_cache with network_info: [{"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Releasing lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-f1cf66a5-2b0f-44e2-868f-3431dfba7872 req-f9ca8030-aaca-4f71-8137-27decfc45806 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-unplugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f1cf66a5-2b0f-44e2-868f-3431dfba7872 req-f9ca8030-aaca-4f71-8137-27decfc45806 service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f1cf66a5-2b0f-44e2-868f-3431dfba7872 req-f9ca8030-aaca-4f71-8137-27decfc45806 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f1cf66a5-2b0f-44e2-868f-3431dfba7872 req-f9ca8030-aaca-4f71-8137-27decfc45806 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-f1cf66a5-2b0f-44e2-868f-3431dfba7872 req-f9ca8030-aaca-4f71-8137-27decfc45806 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-unplugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:54:23 user nova-compute[75993]: WARNING nova.compute.manager [req-f1cf66a5-2b0f-44e2-868f-3431dfba7872 req-f9ca8030-aaca-4f71-8137-27decfc45806 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received unexpected event network-vif-unplugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with vm_state active and task_state reboot_started_hard.
Nov 08 21:54:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:24 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Instance destroyed successfully.
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'resources' on Instance uuid 42555213-8dfd-4b93-8827-2b72ae3ca2e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1820678847',display_name='tempest-TestMinimumBasicScenario-server-1820678847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1820678847',id=30,image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOcUNJ7stKb3KMtT8FxSOLLSev5GAWF4OsBnjWBDFeteLo8WKtCXD+UDLNpLVmo+wgU/JW1M0/sLMFfbSLkzBHfxPeTYrhTogzbuJVsaLeyXpOa5ZXWQL0lTt6/I1AT2A==',key_name='tempest-TestMinimumBasicScenario-1248998495',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:51:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcb84908fd7c41c29be354f4710f3296',ramdisk_id='',reservation_id='r-je062l15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1615594861',owner_user_name='tempest-TestMinimumBasicScenario-1615594861-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:54:23Z,user_data=None,user_id='17537606bbf046cd84a615eb779bab16',uuid=42555213-8dfd-4b93-8827-2b72ae3ca2e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converting VIF {"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_vif [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5659f008-dd, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1995cba5-5e69-4cd2-b308-fa3e1c4f48c1) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:54:24 user nova-compute[75993]: INFO os_vif [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd')
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBqjPKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:54:24 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[70528755-9147-45c3-aca9-534eaf34ce09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:54:24 user nova-compute[75993]: No targets found.
Nov 08 21:54:24 user nova-compute[75993]: iSNS:
Nov 08 21:54:24 user nova-compute[75993]: No targets found.
Nov 08 21:54:24 user nova-compute[75993]: STATIC:
Nov 08 21:54:24 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:54:24 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:54:24 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:54:24 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c
Nov 08 21:54:24 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:54:24 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:54:24 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676
Nov 08 21:54:24 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:54:24 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:54:24 user nova-compute[75993]: FIRMWARE:
Nov 08 21:54:24 user nova-compute[75993]: No targets found.
Nov 08 21:54:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:54:24 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:54:24 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e51287-c31a-4016-a4fc-3c5953f5c184]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7bf33f-be2c-42fc-b685-8c225cdd9fb3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:54:24 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:54:24 user nova-compute[75993]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:54:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:54:24 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:54:24 user nova-compute[75993]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:54:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f858c37a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ec11dd-040b-4615-a55d-60871df0af1b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[924bdd72-5c89-4ab2-b084-3124afb49222]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5172fe87-1a94-4bba-9645-36d87ef07b26]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dfbe78-8ac0-42ba-b37d-1dc87796cc0e]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e949cc6-b05e-4dc0-858b-a73fba3547b1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd25f6a-a808-4b80-be09-a43560f616ad]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260]
Nov 08 21:54:24 user nova-compute[75993]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260] successful.
Nov 08 21:54:24 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b108dd6f-2994-4d68-b6b5-346da1c39937]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] <== disconnect_volume: return (379ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Start _get_guest_xml network_info=[{"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=373173d6-6b3f-47e7-b7fb-7b1d4746676c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '373173d6-6b3f-47e7-b7fb-7b1d4746676c'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'attachment_id': '0f33f0ca-5cbc-43dd-924d-d74bf25a3ac0', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBqjPKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '42555213-8dfd-4b93-8827-2b72ae3ca2e9', 'attached_at': '', 'detached_at': '', 'volume_id': '16576d6c-8af1-4e46-b05c-44547d841676', 'serial': '16576d6c-8af1-4e46-b05c-44547d841676'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:54:24 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:54:24 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=373173d6-6b3f-47e7-b7fb-7b1d4746676c,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'vcpu_model' on Instance uuid 42555213-8dfd-4b93-8827-2b72ae3ca2e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.objects.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Object Instance<42555213-8dfd-4b93-8827-2b72ae3ca2e9> lazy-loaded attributes: resources,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBqjPKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:54:24 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:54:24 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:54:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:54:24 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:54:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3733f82e-3107-4e03-ae9d-384a365d8a99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:54:25 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcf1ec3-cc88-46d7-8957-052461bbc9f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676] added
Nov 08 21:54:25 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a623175e-eceb-4909-be34-ba4204c1e214]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c25103-fb58-42e8-acc2-bc39dc03c0bc]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBqjPKRT {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FBqjPKRT" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef19883-ace4-4116-8adc-c74b4ae29078]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FBqjPKRT'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee343ba-228c-495b-81f3-d8d415be8a57]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffd0f0f-b24f-4592-a644-29be1f843156]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:54:25 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:54:25 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:54:25 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:54:25 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df03daf-4abd-4cb3-a90e-394b29951c78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260]
Nov 08 21:54:25 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260] successful.
Nov 08 21:54:25 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74b9315-726d-4d9a-9fc7-993fa4b76527]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a62877-695a-42ca-a154-59b17514d4dd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:54:25 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:54:25 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:54:25 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:54:25 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:54:25 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:54:25 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff65e8d5-018c-480a-831d-e3b71eb09c6c]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBqjPKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:54:25 user nova-compute[75993]: WARNING nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received unexpected event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with vm_state active and task_state reboot_started_hard.
Nov 08 21:54:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:54:25 user nova-compute[75993]: WARNING nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received unexpected event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with vm_state active and task_state reboot_started_hard.
Nov 08 21:54:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:54:25 user nova-compute[75993]: WARNING nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received unexpected event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with vm_state active and task_state reboot_started_hard.
Nov 08 21:54:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-unplugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-unplugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:54:25 user nova-compute[75993]: WARNING nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received unexpected event network-vif-unplugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with vm_state active and task_state reboot_started_hard.
Nov 08 21:54:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:54:25 user nova-compute[75993]: WARNING nova.compute.manager [req-43b65142-3302-4cfd-8281-9557aa087481 req-1efa6aea-fb3e-4322-a797-f657375ee085 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received unexpected event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with vm_state active and task_state reboot_started_hard.
Nov 08 21:54:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23834636633646639', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834636633646639', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1820678847',display_name='tempest-TestMinimumBasicScenario-server-1820678847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1820678847',id=30,image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOcUNJ7stKb3KMtT8FxSOLLSev5GAWF4OsBnjWBDFeteLo8WKtCXD+UDLNpLVmo+wgU/JW1M0/sLMFfbSLkzBHfxPeTYrhTogzbuJVsaLeyXpOa5ZXWQL0lTt6/I1AT2A==',key_name='tempest-TestMinimumBasicScenario-1248998495',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:51:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcb84908fd7c41c29be354f4710f3296',ramdisk_id='',reservation_id='r-je062l15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1615594861',owner_user_name='tempest-TestMinimumBasicScenario-1615594861-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:54:23Z,user_data=None,user_id='17537606bbf046cd84a615eb779bab16',uuid=42555213-8dfd-4b93-8827-2b72ae3ca2e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converting VIF {"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'pci_devices' on Instance uuid 42555213-8dfd-4b93-8827-2b72ae3ca2e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG nova.objects.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Object Instance<42555213-8dfd-4b93-8827-2b72ae3ca2e9> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:54:26 user nova-compute[75993]:   <uuid>42555213-8dfd-4b93-8827-2b72ae3ca2e9</uuid>
Nov 08 21:54:26 user nova-compute[75993]:   <name>instance-0000001e</name>
Nov 08 21:54:26 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:54:26 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:54:26 user nova-compute[75993]:   <metadata>
Nov 08 21:54:26 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:54:26 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:54:26 user nova-compute[75993]:       <nova:name>tempest-TestMinimumBasicScenario-server-1820678847</nova:name>
Nov 08 21:54:26 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:54:24</nova:creationTime>
Nov 08 21:54:26 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:54:26 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:54:26 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:54:26 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:54:26 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:54:26 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:54:26 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:54:26 user nova-compute[75993]:       <nova:owner>
Nov 08 21:54:26 user nova-compute[75993]:         <nova:user uuid="17537606bbf046cd84a615eb779bab16">tempest-TestMinimumBasicScenario-1615594861-project-member</nova:user>
Nov 08 21:54:26 user nova-compute[75993]:         <nova:project uuid="dcb84908fd7c41c29be354f4710f3296">tempest-TestMinimumBasicScenario-1615594861</nova:project>
Nov 08 21:54:26 user nova-compute[75993]:       </nova:owner>
Nov 08 21:54:26 user nova-compute[75993]:       <nova:root type="image" uuid="373173d6-6b3f-47e7-b7fb-7b1d4746676c"/>
Nov 08 21:54:26 user nova-compute[75993]:       <nova:ports>
Nov 08 21:54:26 user nova-compute[75993]:         <nova:port uuid="5659f008-dda6-4153-b5fb-8cc33eba94ee">
Nov 08 21:54:26 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 21:54:26 user nova-compute[75993]:         </nova:port>
Nov 08 21:54:26 user nova-compute[75993]:       </nova:ports>
Nov 08 21:54:26 user nova-compute[75993]:     </nova:instance>
Nov 08 21:54:26 user nova-compute[75993]:   </metadata>
Nov 08 21:54:26 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:54:26 user nova-compute[75993]:     <system>
Nov 08 21:54:26 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:54:26 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:54:26 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:54:26 user nova-compute[75993]:       <entry name="serial">42555213-8dfd-4b93-8827-2b72ae3ca2e9</entry>
Nov 08 21:54:26 user nova-compute[75993]:       <entry name="uuid">42555213-8dfd-4b93-8827-2b72ae3ca2e9</entry>
Nov 08 21:54:26 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:54:26 user nova-compute[75993]:     </system>
Nov 08 21:54:26 user nova-compute[75993]:   </sysinfo>
Nov 08 21:54:26 user nova-compute[75993]:   <os>
Nov 08 21:54:26 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:54:26 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:54:26 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:54:26 user nova-compute[75993]:   </os>
Nov 08 21:54:26 user nova-compute[75993]:   <features>
Nov 08 21:54:26 user nova-compute[75993]:     <acpi/>
Nov 08 21:54:26 user nova-compute[75993]:     <apic/>
Nov 08 21:54:26 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:54:26 user nova-compute[75993]:   </features>
Nov 08 21:54:26 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:54:26 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:54:26 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:54:26 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:54:26 user nova-compute[75993]:   </clock>
Nov 08 21:54:26 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:54:26 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:54:26 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:54:26 user nova-compute[75993]:   </cpu>
Nov 08 21:54:26 user nova-compute[75993]:   <devices>
Nov 08 21:54:26 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:54:26 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:54:26 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk"/>
Nov 08 21:54:26 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:54:26 user nova-compute[75993]:     </disk>
Nov 08 21:54:26 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:54:26 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:54:26 user nova-compute[75993]:       <source dev="/dev/sdc"/>
Nov 08 21:54:26 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:54:26 user nova-compute[75993]:       <serial>16576d6c-8af1-4e46-b05c-44547d841676</serial>
Nov 08 21:54:26 user nova-compute[75993]:     </disk>
Nov 08 21:54:26 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:54:26 user nova-compute[75993]:       <mac address="fa:16:3e:19:82:5e"/>
Nov 08 21:54:26 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:54:26 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:54:26 user nova-compute[75993]:       <target dev="tap5659f008-dd"/>
Nov 08 21:54:26 user nova-compute[75993]:     </interface>
Nov 08 21:54:26 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:54:26 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/console.log" append="off"/>
Nov 08 21:54:26 user nova-compute[75993]:     </serial>
Nov 08 21:54:26 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:54:26 user nova-compute[75993]:     <video>
Nov 08 21:54:26 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:54:26 user nova-compute[75993]:     </video>
Nov 08 21:54:26 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:54:26 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:54:26 user nova-compute[75993]:     </rng>
Nov 08 21:54:26 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:54:26 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:54:26 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:54:26 user nova-compute[75993]:     </memballoon>
Nov 08 21:54:26 user nova-compute[75993]:   </devices>
Nov 08 21:54:26 user nova-compute[75993]: </domain>
Nov 08 21:54:26 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'trusted_certs' on Instance uuid 42555213-8dfd-4b93-8827-2b72ae3ca2e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG nova.objects.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Object Instance<42555213-8dfd-4b93-8827-2b72ae3ca2e9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:54:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0 --force-share --output=json" returned: 0 in 0.211s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Cannot resize image /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'migration_context' on Instance uuid 42555213-8dfd-4b93-8827-2b72ae3ca2e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG nova.objects.base [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Object Instance<42555213-8dfd-4b93-8827-2b72ae3ca2e9> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1820678847',display_name='tempest-TestMinimumBasicScenario-server-1820678847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1820678847',id=30,image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOcUNJ7stKb3KMtT8FxSOLLSev5GAWF4OsBnjWBDFeteLo8WKtCXD+UDLNpLVmo+wgU/JW1M0/sLMFfbSLkzBHfxPeTYrhTogzbuJVsaLeyXpOa5ZXWQL0lTt6/I1AT2A==',key_name='tempest-TestMinimumBasicScenario-1248998495',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:51:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='dcb84908fd7c41c29be354f4710f3296',ramdisk_id='',reservation_id='r-je062l15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1615594861',owner_user_name='tempest-TestMinimumBasicScenario-1615594861-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:54:23Z,user_data=None,user_id='17537606bbf046cd84a615eb779bab16',uuid=42555213-8dfd-4b93-8827-2b72ae3ca2e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converting VIF {"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG os_vif [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1c666563-e3fd-5b1a-b0cf-1b105576a60d', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5659f008-dd, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5659f008-dd, col_values=(('qos', UUID('9dad0726-0ea2-4b0d-adf1-6dddc9885534')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5659f008-dd, col_values=(('external_ids', {'iface-id': '5659f008-dda6-4153-b5fb-8cc33eba94ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:82:5e', 'vm-uuid': '42555213-8dfd-4b93-8827-2b72ae3ca2e9'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:54:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:27 user nova-compute[75993]: INFO os_vif [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd')
Nov 08 21:54:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-d0b44df2-b614-4f23-bef3-5a4ca232881c req-ec475b5d-1763-45ab-8997-dd42866d4de9 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d0b44df2-b614-4f23-bef3-5a4ca232881c req-ec475b5d-1763-45ab-8997-dd42866d4de9 service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d0b44df2-b614-4f23-bef3-5a4ca232881c req-ec475b5d-1763-45ab-8997-dd42866d4de9 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d0b44df2-b614-4f23-bef3-5a4ca232881c req-ec475b5d-1763-45ab-8997-dd42866d4de9 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-d0b44df2-b614-4f23-bef3-5a4ca232881c req-ec475b5d-1763-45ab-8997-dd42866d4de9 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:54:29 user nova-compute[75993]: WARNING nova.compute.manager [req-d0b44df2-b614-4f23-bef3-5a4ca232881c req-ec475b5d-1763-45ab-8997-dd42866d4de9 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received unexpected event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with vm_state active and task_state reboot_started_hard.
Nov 08 21:54:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-78984611-73ce-4a1a-bc11-1b3c58df8fb9 req-cc19af4b-a7eb-44b2-90cb-9d5a1066d609 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78984611-73ce-4a1a-bc11-1b3c58df8fb9 req-cc19af4b-a7eb-44b2-90cb-9d5a1066d609 service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78984611-73ce-4a1a-bc11-1b3c58df8fb9 req-cc19af4b-a7eb-44b2-90cb-9d5a1066d609 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78984611-73ce-4a1a-bc11-1b3c58df8fb9 req-cc19af4b-a7eb-44b2-90cb-9d5a1066d609 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-78984611-73ce-4a1a-bc11-1b3c58df8fb9 req-cc19af4b-a7eb-44b2-90cb-9d5a1066d609 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:54:31 user nova-compute[75993]: WARNING nova.compute.manager [req-78984611-73ce-4a1a-bc11-1b3c58df8fb9 req-cc19af4b-a7eb-44b2-90cb-9d5a1066d609 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received unexpected event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with vm_state active and task_state reboot_started_hard.
Nov 08 21:54:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:54:31 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Instance rebooted successfully.
Nov 08 21:54:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e1cad28c-3a79-458c-aa76-37a52669edb1 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.962s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:31 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:54:31 user nova-compute[75993]: INFO nova.compute.claims [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Claim successful on node user
Nov 08 21:54:32 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:54:32 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:54:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:54:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:54:32 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:54:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:54:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:54:32 user nova-compute[75993]: INFO nova.virt.block_device [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Booting with volume-backed-image 6094807b-c5f6-4b2a-ac9a-5175832ce24b at /dev/vda
Nov 08 21:54:32 user nova-compute[75993]: DEBUG nova.policy [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78965be8230646288b7fc0443c3f4f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb1547c59f8e4d85ad6f650b01243357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:54:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:32 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Successfully created port: cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:54:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Successfully updated port: cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:54:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:54:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquired lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:54:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:54:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:54:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-7622098c-6697-408e-9549-91be0819731b req-5f871fe6-18a3-4e48-84e2-d366f6b5070e service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-changed-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-7622098c-6697-408e-9549-91be0819731b req-5f871fe6-18a3-4e48-84e2-d366f6b5070e service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Refreshing instance network info cache due to event network-changed-cafc456a-96ff-4e51-b0d5-9237991809c7. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:54:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7622098c-6697-408e-9549-91be0819731b req-5f871fe6-18a3-4e48-84e2-d366f6b5070e service nova] Acquiring lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Updating instance_info_cache with network_info: [{"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Releasing lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Instance network_info: |[{"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7622098c-6697-408e-9549-91be0819731b req-5f871fe6-18a3-4e48-84e2-d366f6b5070e service nova] Acquired lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-7622098c-6697-408e-9549-91be0819731b req-5f871fe6-18a3-4e48-84e2-d366f6b5070e service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Refreshing network info cache for port cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-7622098c-6697-408e-9549-91be0819731b req-5f871fe6-18a3-4e48-84e2-d366f6b5070e service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Updated VIF entry in instance network info cache for port cafc456a-96ff-4e51-b0d5-9237991809c7. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-7622098c-6697-408e-9549-91be0819731b req-5f871fe6-18a3-4e48-84e2-d366f6b5070e service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Updating instance_info_cache with network_info: [{"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7622098c-6697-408e-9549-91be0819731b req-5f871fe6-18a3-4e48-84e2-d366f6b5070e service nova] Releasing lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:54:34 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 41c2971c-5db5-4951-8adf-ffbe063498dc is timed out.
Nov 08 21:54:34 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Successfully detached device vdb from instance 41c2971c-5db5-4951-8adf-ffbe063498dc from the live domain config.
Nov 08 21:54:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egkiBOxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:54:34 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:54:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d8dc20-f91f-458f-b943-ef46376fc22e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:54:34 user nova-compute[75993]: No targets found.
Nov 08 21:54:34 user nova-compute[75993]: iSNS:
Nov 08 21:54:34 user nova-compute[75993]: No targets found.
Nov 08 21:54:34 user nova-compute[75993]: STATIC:
Nov 08 21:54:34 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:54:34 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:54:34 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:54:34 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c
Nov 08 21:54:34 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:54:34 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:54:34 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676
Nov 08 21:54:34 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:54:34 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:54:34 user nova-compute[75993]: FIRMWARE:
Nov 08 21:54:34 user nova-compute[75993]: No targets found.
Nov 08 21:54:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:54:34 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:54:34 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7c627-0843-45d4-920c-34a1732a8a1d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eec6ec-8d27-4fbe-8579-8c725d11a33a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:54:34 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:54:34 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:54:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:54:34 user nova-compute[75993]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c (non-flash)
Nov 08 21:54:34 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:54:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544b4bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d65e9d6-7047-436b-bfd7-7f067a016112]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f2924b-aa43-4508-8185-cb365eca8bec]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0734c3f1-55a9-43a3-b829-0f432917b05c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff7f349-d78e-4043-972a-af9ab31079c3]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b8b8cf-f9d4-4d4b-b1d9-5028387b54c8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d025f0-e151-4442-a9cf-56133c5565dd]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c, portal: 172.16.0.220,3260]
Nov 08 21:54:35 user nova-compute[75993]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c, portal: 172.16.0.220,3260] successful.
Nov 08 21:54:35 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[25042931-8828-4954-a5e8-6acb844eaf3d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] <== disconnect_volume: return (368ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:54:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG nova.objects.instance [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lazy-loading 'flavor' on Instance uuid 41c2971c-5db5-4951-8adf-ffbe063498dc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8c5c459f-1f5e-4137-984a-c0558866fb34 tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.246s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.130s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:36 user nova-compute[75993]: INFO nova.compute.manager [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Terminating instance
Nov 08 21:54:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-0a785bc5-b54a-4228-99fe-b9a7e92e8ff2 req-b216e8a1-848a-45f9-a45c-60976b7227dd service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Received event network-vif-unplugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0a785bc5-b54a-4228-99fe-b9a7e92e8ff2 req-b216e8a1-848a-45f9-a45c-60976b7227dd service nova] Acquiring lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0a785bc5-b54a-4228-99fe-b9a7e92e8ff2 req-b216e8a1-848a-45f9-a45c-60976b7227dd service nova] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0a785bc5-b54a-4228-99fe-b9a7e92e8ff2 req-b216e8a1-848a-45f9-a45c-60976b7227dd service nova] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-0a785bc5-b54a-4228-99fe-b9a7e92e8ff2 req-b216e8a1-848a-45f9-a45c-60976b7227dd service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] No waiting events found dispatching network-vif-unplugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:54:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-0a785bc5-b54a-4228-99fe-b9a7e92e8ff2 req-b216e8a1-848a-45f9-a45c-60976b7227dd service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Received event network-vif-unplugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:54:37 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Instance destroyed successfully.
Nov 08 21:54:37 user nova-compute[75993]: DEBUG nova.objects.instance [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lazy-loading 'resources' on Instance uuid 41c2971c-5db5-4951-8adf-ffbe063498dc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-763946221',display_name='tempest-VolumesSnapshotTestJSON-instance-763946221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-763946221',id=29,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1CwvlP6OoJR4hMt+xo8FAm4z1VRPDT1rk7ix6D0hsMJN5jLXjidnxJHmHM3rYVuZ/NauDFh6TkV9kWjZONC4tscTeutZT4LxmtNjK3GyQ+YUqUKfsMIpL0dhv3Vfmnpg==',key_name='tempest-keypair-1795797978',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:50:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b942ec0575e4665a594614ccba455d3',ramdisk_id='',reservation_id='r-1660q65m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1072091596',owner_user_name='tempest-VolumesSnapshotTestJSON-1072091596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:50:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b330b61ef9cd48bdacbb7a7a695f34cb',uuid=41c2971c-5db5-4951-8adf-ffbe063498dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "address": "fa:16:3e:34:e9:65", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef176aaa-2d", "ovs_interfaceid": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converting VIF {"id": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "address": "fa:16:3e:34:e9:65", "network": {"id": "dd4069fe-612e-4ee0-ad3b-13929526dded", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1252793780-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b942ec0575e4665a594614ccba455d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef176aaa-2d", "ovs_interfaceid": "ef176aaa-2d27-4798-a4c8-e522e717bca3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:e9:65,bridge_name='br-int',has_traffic_filtering=True,id=ef176aaa-2d27-4798-a4c8-e522e717bca3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef176aaa-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_vif [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:e9:65,bridge_name='br-int',has_traffic_filtering=True,id=ef176aaa-2d27-4798-a4c8-e522e717bca3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef176aaa-2d') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef176aaa-2d, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=265c6232-5f04-4a54-8c45-e71443b94f16) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:37 user nova-compute[75993]: INFO os_vif [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:e9:65,bridge_name='br-int',has_traffic_filtering=True,id=ef176aaa-2d27-4798-a4c8-e522e717bca3,network=Network(dd4069fe-612e-4ee0-ad3b-13929526dded),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef176aaa-2d')
Nov 08 21:54:37 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'egkiBOxL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:54:37 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[76367011-a18a-4621-a69d-c4fd4975fd04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:54:37 user nova-compute[75993]: No targets found.
Nov 08 21:54:37 user nova-compute[75993]: iSNS:
Nov 08 21:54:37 user nova-compute[75993]: No targets found.
Nov 08 21:54:37 user nova-compute[75993]: STATIC:
Nov 08 21:54:37 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:54:37 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:54:37 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:54:37 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676
Nov 08 21:54:37 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:54:37 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:54:37 user nova-compute[75993]: FIRMWARE:
Nov 08 21:54:37 user nova-compute[75993]: No targets found.
Nov 08 21:54:37 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:54:37 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:54:37 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e04aa30-b313-42fd-9074-a61176aaef4c', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8885fd40-81b1-4c69-a709-108349af8965]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db6d756-2146-48d3-b3e9-3b55fe6ba0ff]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:54:37 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:54:37 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:54:37 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:54:37 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544b47910>, {}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Disconnecting from: [] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.096s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] <== disconnect_volume: return (98ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:54:37 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Deleting instance files /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc_del
Nov 08 21:54:37 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Deletion of /opt/stack/data/nova/instances/41c2971c-5db5-4951-8adf-ffbe063498dc_del complete
Nov 08 21:54:37 user nova-compute[75993]: INFO nova.compute.manager [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 08 21:54:37 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:54:37 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:54:38 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:54:38 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Took 1.30 seconds to deallocate network for instance.
Nov 08 21:54:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-5307375a-d841-4c80-ad8d-249047ef2d4b req-23027ba2-7a1e-4914-a4eb-d24ca0dc59b0 service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Received event network-vif-plugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5307375a-d841-4c80-ad8d-249047ef2d4b req-23027ba2-7a1e-4914-a4eb-d24ca0dc59b0 service nova] Acquiring lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5307375a-d841-4c80-ad8d-249047ef2d4b req-23027ba2-7a1e-4914-a4eb-d24ca0dc59b0 service nova] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5307375a-d841-4c80-ad8d-249047ef2d4b req-23027ba2-7a1e-4914-a4eb-d24ca0dc59b0 service nova] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-5307375a-d841-4c80-ad8d-249047ef2d4b req-23027ba2-7a1e-4914-a4eb-d24ca0dc59b0 service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] No waiting events found dispatching network-vif-plugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:54:38 user nova-compute[75993]: WARNING nova.compute.manager [req-5307375a-d841-4c80-ad8d-249047ef2d4b req-23027ba2-7a1e-4914-a4eb-d24ca0dc59b0 service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Received unexpected event network-vif-plugged-ef176aaa-2d27-4798-a4c8-e522e717bca3 for instance with vm_state active and task_state deleting.
Nov 08 21:54:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-ba4d8c1f-7620-429d-898f-6bc8342a4a94 req-169058d6-7b3b-431f-9667-d939579d7623 service nova] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Received event network-vif-deleted-ef176aaa-2d27-4798-a4c8-e522e717bca3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:54:38 user nova-compute[75993]: WARNING nova.volume.cinder [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Attachment 27a0e8c5-ecd8-4ced-ba57-60e87d0a9fb8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 27a0e8c5-ecd8-4ced-ba57-60e87d0a9fb8. (HTTP 404) (Request-ID: req-ad0ea87b-f80a-4d5f-b8d9-414e48e97073)
Nov 08 21:54:38 user nova-compute[75993]: INFO nova.compute.manager [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] [instance: 41c2971c-5db5-4951-8adf-ffbe063498dc] Took 0.03 seconds to detach 1 volumes for instance.
Nov 08 21:54:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:54:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:54:39 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:54:39 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:54:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:39 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Deleted allocations for instance 41c2971c-5db5-4951-8adf-ffbe063498dc
Nov 08 21:54:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4147b1c6-b6d4-468e-8054-8f492c7a232a tempest-VolumesSnapshotTestJSON-1072091596 tempest-VolumesSnapshotTestJSON-1072091596-project-member] Lock "41c2971c-5db5-4951-8adf-ffbe063498dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.118s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:54:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG os_brick.utils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[974bfbc4-08b0-4ac2-ad64-1ad6de1a44b7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cbac95-ed3a-4584-ae7f-ad8753dcb2e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16bed47-d58b-4935-811f-3582fae54810]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[82235e6f-baca-4853-95bc-c0c0c8d4b014]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:54:53 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:54:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fac234-9e7c-4c2a-b41b-461e3679b402]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG os_brick.utils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:54:53 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Updating existing volume attachment record: 090c71d1-5600-4b94-a7cd-a62b884cc393 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:54:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:54:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:54:59 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:55:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:55:05 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:55:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:55:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:55:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:55:05 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:55:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:55:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:55:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:08 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:55:08 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8242MB free_disk=25.013389587402344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:55:08 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:55:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:55:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.911s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:55:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:55:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:55:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:55:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:55:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:55:10 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updating instance_info_cache with network_info: [{"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:55:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:55:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:55:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:55:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:55:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:55:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:55:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:55:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 21:55:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:55:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:13 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:55:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:55:18 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:55:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 21:55:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:55:20 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Creating image(s)
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Ensure instance console log exists: /opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Start _get_guest_xml network_info=[{"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '090c71d1-5600-4b94-a7cd-a62b884cc393', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCqrJaId', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd4f0f927-23ad-4f92-acbb-cf6757f9c4e9', 'attached_at': '', 'detached_at': '', 'volume_id': '5c697987-9d0d-43f4-9772-a6b24a15559d', 'serial': '5c697987-9d0d-43f4-9772-a6b24a15559d'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:55:20 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:55:20 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:55:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCqrJaId', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:55:21 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:55:21 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:55:21 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0758446c-2f2d-4289-8763-036a3eb82b28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:55:21 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e75dccb-6942-4c7e-b682-dc4edca0b167]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d] added
Nov 08 21:55:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7ab8fa-756b-4289-bdde-6dea036da294]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c084bd90-1fda-42a9-aaf6-764d766e1481]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCqrJaId {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCqrJaId" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd48036-65b7-42df-bc0a-b860fb899d80]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YCqrJaId'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea034f7-1375-4adf-881a-3cf8b627cfd9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e288a1-a649-49d0-8041-1bc3cdf06bac]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:55:21 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:55:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:55:21 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:55:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e82c1bc-c1e1-457b-9824-42576f4d5ab8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d, portal: 172.16.0.220,3260]
Nov 08 21:55:21 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d, portal: 172.16.0.220,3260] successful.
Nov 08 21:55:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[77202223-9116-4554-89aa-0e6b46ffced9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f575e6ff-a571-44f6-a57f-8d832130ed23]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:55:21 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:55:21 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:55:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:55:21 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:55:21 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:55:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b431fa9-a180-4059-b5cf-1802fa5d5f49]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:55:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCqrJaId', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26134653161363662', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134653161363662', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1834406264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1834406264',id=32,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-4tl9r080',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:54:32Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=d4f0f927-23ad-4f92-acbb-cf6757f9c4e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:f6:55,bridge_name='br-int',has_traffic_filtering=True,id=cafc456a-96ff-4e51-b0d5-9237991809c7,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafc456a-96') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG nova.objects.instance [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'pci_devices' on Instance uuid d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:55:22 user nova-compute[75993]:   <uuid>d4f0f927-23ad-4f92-acbb-cf6757f9c4e9</uuid>
Nov 08 21:55:22 user nova-compute[75993]:   <name>instance-00000020</name>
Nov 08 21:55:22 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:55:22 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:55:22 user nova-compute[75993]:   <metadata>
Nov 08 21:55:22 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:55:22 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:55:22 user nova-compute[75993]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1834406264</nova:name>
Nov 08 21:55:22 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:55:20</nova:creationTime>
Nov 08 21:55:22 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:55:22 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:55:22 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:55:22 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:55:22 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:55:22 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:55:22 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:55:22 user nova-compute[75993]:       <nova:owner>
Nov 08 21:55:22 user nova-compute[75993]:         <nova:user uuid="78965be8230646288b7fc0443c3f4f6c">tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member</nova:user>
Nov 08 21:55:22 user nova-compute[75993]:         <nova:project uuid="fb1547c59f8e4d85ad6f650b01243357">tempest-ServerBootFromVolumeStableRescueTest-571934265</nova:project>
Nov 08 21:55:22 user nova-compute[75993]:       </nova:owner>
Nov 08 21:55:22 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:55:22 user nova-compute[75993]:       <nova:ports>
Nov 08 21:55:22 user nova-compute[75993]:         <nova:port uuid="cafc456a-96ff-4e51-b0d5-9237991809c7">
Nov 08 21:55:22 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 21:55:22 user nova-compute[75993]:         </nova:port>
Nov 08 21:55:22 user nova-compute[75993]:       </nova:ports>
Nov 08 21:55:22 user nova-compute[75993]:     </nova:instance>
Nov 08 21:55:22 user nova-compute[75993]:   </metadata>
Nov 08 21:55:22 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:55:22 user nova-compute[75993]:     <system>
Nov 08 21:55:22 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:55:22 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:55:22 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:55:22 user nova-compute[75993]:       <entry name="serial">d4f0f927-23ad-4f92-acbb-cf6757f9c4e9</entry>
Nov 08 21:55:22 user nova-compute[75993]:       <entry name="uuid">d4f0f927-23ad-4f92-acbb-cf6757f9c4e9</entry>
Nov 08 21:55:22 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:55:22 user nova-compute[75993]:     </system>
Nov 08 21:55:22 user nova-compute[75993]:   </sysinfo>
Nov 08 21:55:22 user nova-compute[75993]:   <os>
Nov 08 21:55:22 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:55:22 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:55:22 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:55:22 user nova-compute[75993]:   </os>
Nov 08 21:55:22 user nova-compute[75993]:   <features>
Nov 08 21:55:22 user nova-compute[75993]:     <acpi/>
Nov 08 21:55:22 user nova-compute[75993]:     <apic/>
Nov 08 21:55:22 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:55:22 user nova-compute[75993]:   </features>
Nov 08 21:55:22 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:55:22 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:55:22 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:55:22 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:55:22 user nova-compute[75993]:   </clock>
Nov 08 21:55:22 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:55:22 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:55:22 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:55:22 user nova-compute[75993]:   </cpu>
Nov 08 21:55:22 user nova-compute[75993]:   <devices>
Nov 08 21:55:22 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:55:22 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:55:22 user nova-compute[75993]:       <source dev="/dev/sdb"/>
Nov 08 21:55:22 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:55:22 user nova-compute[75993]:       <serial>5c697987-9d0d-43f4-9772-a6b24a15559d</serial>
Nov 08 21:55:22 user nova-compute[75993]:     </disk>
Nov 08 21:55:22 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:55:22 user nova-compute[75993]:       <mac address="fa:16:3e:00:f6:55"/>
Nov 08 21:55:22 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:55:22 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:55:22 user nova-compute[75993]:       <target dev="tapcafc456a-96"/>
Nov 08 21:55:22 user nova-compute[75993]:     </interface>
Nov 08 21:55:22 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:55:22 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/console.log" append="off"/>
Nov 08 21:55:22 user nova-compute[75993]:     </serial>
Nov 08 21:55:22 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:55:22 user nova-compute[75993]:     <video>
Nov 08 21:55:22 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:55:22 user nova-compute[75993]:     </video>
Nov 08 21:55:22 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:55:22 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:55:22 user nova-compute[75993]:     </rng>
Nov 08 21:55:22 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:55:22 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:55:22 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:55:22 user nova-compute[75993]:     </memballoon>
Nov 08 21:55:22 user nova-compute[75993]:   </devices>
Nov 08 21:55:22 user nova-compute[75993]: </domain>
Nov 08 21:55:22 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1834406264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1834406264',id=32,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-4tl9r080',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:54:32Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=d4f0f927-23ad-4f92-acbb-cf6757f9c4e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:f6:55,bridge_name='br-int',has_traffic_filtering=True,id=cafc456a-96ff-4e51-b0d5-9237991809c7,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafc456a-96') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG os_vif [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f6:55,bridge_name='br-int',has_traffic_filtering=True,id=cafc456a-96ff-4e51-b0d5-9237991809c7,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafc456a-96') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a77446c1-75cb-5ba7-b63c-ce7ba2245468', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcafc456a-96, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcafc456a-96, col_values=(('qos', UUID('74306b0f-bde0-42b1-86bb-167234b066b2')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcafc456a-96, col_values=(('external_ids', {'iface-id': 'cafc456a-96ff-4e51-b0d5-9237991809c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:f6:55', 'vm-uuid': 'd4f0f927-23ad-4f92-acbb-cf6757f9c4e9'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:22 user nova-compute[75993]: INFO os_vif [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f6:55,bridge_name='br-int',has_traffic_filtering=True,id=cafc456a-96ff-4e51-b0d5-9237991809c7,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafc456a-96')
Nov 08 21:55:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:55:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No VIF found with MAC fa:16:3e:00:f6:55, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:55:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-f35db1d5-0f5d-4590-b412-197f3a11ee3b req-5f885253-a72d-408b-9c36-68a706fbab7f service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:55:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f35db1d5-0f5d-4590-b412-197f3a11ee3b req-5f885253-a72d-408b-9c36-68a706fbab7f service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:55:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f35db1d5-0f5d-4590-b412-197f3a11ee3b req-5f885253-a72d-408b-9c36-68a706fbab7f service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:55:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f35db1d5-0f5d-4590-b412-197f3a11ee3b req-5f885253-a72d-408b-9c36-68a706fbab7f service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:55:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-f35db1d5-0f5d-4590-b412-197f3a11ee3b req-5f885253-a72d-408b-9c36-68a706fbab7f service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:55:24 user nova-compute[75993]: WARNING nova.compute.manager [req-f35db1d5-0f5d-4590-b412-197f3a11ee3b req-5f885253-a72d-408b-9c36-68a706fbab7f service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received unexpected event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with vm_state building and task_state spawning.
Nov 08 21:55:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-2846ccec-dcef-4c87-803e-870a84f9924a req-252152ab-2dab-4152-a0c8-7de1f4ea21f3 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2846ccec-dcef-4c87-803e-870a84f9924a req-252152ab-2dab-4152-a0c8-7de1f4ea21f3 service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2846ccec-dcef-4c87-803e-870a84f9924a req-252152ab-2dab-4152-a0c8-7de1f4ea21f3 service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2846ccec-dcef-4c87-803e-870a84f9924a req-252152ab-2dab-4152-a0c8-7de1f4ea21f3 service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-2846ccec-dcef-4c87-803e-870a84f9924a req-252152ab-2dab-4152-a0c8-7de1f4ea21f3 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:55:26 user nova-compute[75993]: WARNING nova.compute.manager [req-2846ccec-dcef-4c87-803e-870a84f9924a req-252152ab-2dab-4152-a0c8-7de1f4ea21f3 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received unexpected event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with vm_state building and task_state spawning.
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:55:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Instance spawned successfully.
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:55:26 user nova-compute[75993]: INFO nova.compute.manager [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 08 21:55:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:55:26 user nova-compute[75993]: INFO nova.compute.manager [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Took 55.31 seconds to build instance.
Nov 08 21:55:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6ce50b65-6ca4-446d-a0ad-bea410043b0f tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 55.416s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:55:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:55:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:55:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:55:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:55:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:55:50 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:55:50 user nova-compute[75993]: INFO nova.compute.claims [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Claim successful on node user
Nov 08 21:55:51 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:55:51 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:55:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG nova.policy [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24c7a7bdeeda41339b11c9e9e1ad4c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696fc6c404c244ccba1a90b11e5437de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:51 user nova-compute[75993]: INFO nova.virt.block_device [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Booting with volume d066025e-5c4a-478d-b7c8-4b70449486e4 at /dev/vda
Nov 08 21:55:51 user nova-compute[75993]: DEBUG os_brick.utils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d140e6aa-7113-40c8-b7d0-387df9d35b27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[731586d3-4d49-44e0-930f-0aed3866105d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aae8251-2c3d-4d32-a28c-80369a836f82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57a1fd4-2227-42bd-931c-f1f1a801d2f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:55:51 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:55:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ffa1e-4d0a-4d12-88e3-57b486680765]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG os_brick.utils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:55:51 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating existing volume attachment record: c05ddbcc-3969-48d7-8745-0b3572f30e02 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:55:52 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Successfully created port: 817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:55:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Successfully updated port: 817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquired lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG nova.compute.manager [req-77311c2e-1e03-4b81-b2a8-c8596431139e req-5100cc79-a079-4eed-b2c6-833739e2c556 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-changed-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG nova.compute.manager [req-77311c2e-1e03-4b81-b2a8-c8596431139e req-5100cc79-a079-4eed-b2c6-833739e2c556 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Refreshing instance network info cache due to event network-changed-817baf15-2d4e-4d79-ab15-e70b6317cf5a. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-77311c2e-1e03-4b81-b2a8-c8596431139e req-5100cc79-a079-4eed-b2c6-833739e2c556 service nova] Acquiring lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG nova.network.neutron [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating instance_info_cache with network_info: [{"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Releasing lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Instance network_info: |[{"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-77311c2e-1e03-4b81-b2a8-c8596431139e req-5100cc79-a079-4eed-b2c6-833739e2c556 service nova] Acquired lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG nova.network.neutron [req-77311c2e-1e03-4b81-b2a8-c8596431139e req-5100cc79-a079-4eed-b2c6-833739e2c556 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Refreshing network info cache for port 817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG nova.network.neutron [req-77311c2e-1e03-4b81-b2a8-c8596431139e req-5100cc79-a079-4eed-b2c6-833739e2c556 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updated VIF entry in instance network info cache for port 817baf15-2d4e-4d79-ab15-e70b6317cf5a. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG nova.network.neutron [req-77311c2e-1e03-4b81-b2a8-c8596431139e req-5100cc79-a079-4eed-b2c6-833739e2c556 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating instance_info_cache with network_info: [{"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:55:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-77311c2e-1e03-4b81-b2a8-c8596431139e req-5100cc79-a079-4eed-b2c6-833739e2c556 service nova] Releasing lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:55:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:55:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:01 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:56:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:06 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:56:06 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:56:06 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:56:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:56:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:56:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:56:06 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:56:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:56:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:56:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:09 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:56:09 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8204MB free_disk=24.99944305419922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d5fe6095-7bc6-48ae-b858-5ea2148ee423 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:56:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:56:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:56:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:56:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:56:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:56:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:56:12 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updating instance_info_cache with network_info: [{"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:56:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:56:12 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:56:12 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:56:12 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:56:12 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:56:12 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:56:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:56:14 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:56:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-6fb6abcc-b9b1-4e44-abb9-37c0db9b98de req-a4ba296d-5439-4a8e-a986-67bddd11b225 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-changed-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:56:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-6fb6abcc-b9b1-4e44-abb9-37c0db9b98de req-a4ba296d-5439-4a8e-a986-67bddd11b225 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Refreshing instance network info cache due to event network-changed-5659f008-dda6-4153-b5fb-8cc33eba94ee. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:56:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6fb6abcc-b9b1-4e44-abb9-37c0db9b98de req-a4ba296d-5439-4a8e-a986-67bddd11b225 service nova] Acquiring lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:56:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6fb6abcc-b9b1-4e44-abb9-37c0db9b98de req-a4ba296d-5439-4a8e-a986-67bddd11b225 service nova] Acquired lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:56:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-6fb6abcc-b9b1-4e44-abb9-37c0db9b98de req-a4ba296d-5439-4a8e-a986-67bddd11b225 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Refreshing network info cache for port 5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:56:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-6fb6abcc-b9b1-4e44-abb9-37c0db9b98de req-a4ba296d-5439-4a8e-a986-67bddd11b225 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updated VIF entry in instance network info cache for port 5659f008-dda6-4153-b5fb-8cc33eba94ee. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:56:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-6fb6abcc-b9b1-4e44-abb9-37c0db9b98de req-a4ba296d-5439-4a8e-a986-67bddd11b225 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updating instance_info_cache with network_info: [{"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:56:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6fb6abcc-b9b1-4e44-abb9-37c0db9b98de req-a4ba296d-5439-4a8e-a986-67bddd11b225 service nova] Releasing lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:56:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG nova.compute.manager [req-6991dec6-870e-42c5-9d09-a7a0476d0f81 req-1d8d9fe2-a2cd-457a-9f53-85b19d32f7fd service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-changed-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG nova.compute.manager [req-6991dec6-870e-42c5-9d09-a7a0476d0f81 req-1d8d9fe2-a2cd-457a-9f53-85b19d32f7fd service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Refreshing instance network info cache due to event network-changed-5659f008-dda6-4153-b5fb-8cc33eba94ee. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6991dec6-870e-42c5-9d09-a7a0476d0f81 req-1d8d9fe2-a2cd-457a-9f53-85b19d32f7fd service nova] Acquiring lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6991dec6-870e-42c5-9d09-a7a0476d0f81 req-1d8d9fe2-a2cd-457a-9f53-85b19d32f7fd service nova] Acquired lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG nova.network.neutron [req-6991dec6-870e-42c5-9d09-a7a0476d0f81 req-1d8d9fe2-a2cd-457a-9f53-85b19d32f7fd service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Refreshing network info cache for port 5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:56:17 user nova-compute[75993]: INFO nova.compute.manager [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Detaching volume 16576d6c-8af1-4e46-b05c-44547d841676
Nov 08 21:56:17 user nova-compute[75993]: INFO nova.virt.block_device [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Attempting to driver detach volume 16576d6c-8af1-4e46-b05c-44547d841676 from mountpoint /dev/vdb
Nov 08 21:56:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Attempting to detach device vdb from instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:56:17 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:56:17 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 21:56:17 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:56:17 user nova-compute[75993]:   <serial>16576d6c-8af1-4e46-b05c-44547d841676</serial>
Nov 08 21:56:17 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 21:56:17 user nova-compute[75993]: </disk>
Nov 08 21:56:17 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:56:17 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Successfully detached device vdb from instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 from the persistent domain config.
Nov 08 21:56:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 21:56:17 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:56:17 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 21:56:17 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 21:56:17 user nova-compute[75993]:   <serial>16576d6c-8af1-4e46-b05c-44547d841676</serial>
Nov 08 21:56:17 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 21:56:17 user nova-compute[75993]: </disk>
Nov 08 21:56:17 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG nova.network.neutron [req-6991dec6-870e-42c5-9d09-a7a0476d0f81 req-1d8d9fe2-a2cd-457a-9f53-85b19d32f7fd service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updated VIF entry in instance network info cache for port 5659f008-dda6-4153-b5fb-8cc33eba94ee. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:56:17 user nova-compute[75993]: DEBUG nova.network.neutron [req-6991dec6-870e-42c5-9d09-a7a0476d0f81 req-1d8d9fe2-a2cd-457a-9f53-85b19d32f7fd service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updating instance_info_cache with network_info: [{"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:56:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6991dec6-870e-42c5-9d09-a7a0476d0f81 req-1d8d9fe2-a2cd-457a-9f53-85b19d32f7fd service nova] Releasing lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:56:19 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Creating image(s)
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Ensure instance console log exists: /opt/stack/data/nova/instances/d5fe6095-7bc6-48ae-b858-5ea2148ee423/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Start _get_guest_xml network_info=[{"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'c05ddbcc-3969-48d7-8745-0b3572f30e02', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTeEifgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5fe6095-7bc6-48ae-b858-5ea2148ee423', 'attached_at': '', 'detached_at': '', 'volume_id': 'd066025e-5c4a-478d-b7c8-4b70449486e4', 'serial': 'd066025e-5c4a-478d-b7c8-4b70449486e4'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:56:19 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:56:19 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTeEifgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:56:19 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:56:19 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:56:19 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd05ec34-ab93-4848-9643-b8d34b0a2b65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:56:19 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a73f99-6f59-4bb7-9d98-4a2b1907a152]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4] added
Nov 08 21:56:19 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf613a6-a3f1-4af7-b693-f997bcea0d1b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d981fe6-09c5-4f64-ac5d-6aadf5f69b90]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTeEifgZ {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTeEifgZ" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[927d5b20-aac2-43b4-8823-9977e0125d94]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTeEifgZ'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bc503a-ac20-4ebf-8818-c1ab438a763d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecf73e6-09f5-4dc4-aa70-28a5bb6b2949]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:56:19 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:56:19 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:56:19 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:56:19 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:56:19 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:56:19 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e933b79-3fd4-4cb7-abee-13891f06d7d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260]
Nov 08 21:56:19 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260] successful.
Nov 08 21:56:19 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e8efde-64d7-4ea1-93fa-15d984002fcf]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eab379-e120-42de-9a9e-aff261bca9db]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:56:19 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:56:19 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:56:19 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:56:19 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:56:19 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:56:19 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:56:19 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:56:19 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2f04b4-828d-4f94-9e90-a75cac8700aa]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:56:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTeEifgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== connect_volume: return (1399ms) {'type': 'block', 'scsi_wwn': '23236623162623364', 'path': '/dev/sde'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236623162623364', 'path': '/dev/sde'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836352422',display_name='tempest-ServerActionsTestOtherA-server-1836352422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836352422',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIbQxx7DuVFUAXtivYRWFOk6i/ACW0OwEKdIgB2j1c2VjAAObwQ9qWcNKT6+OGS47GK/q93vubsJMppLLdAeY5qiAyBaCE0GMrdNogpncAZOwVmmfngYFO0ELy5AfYiWQ==',key_name='tempest-keypair-1988537750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-ep0z5zdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=d5fe6095-7bc6-48ae-b858-5ea2148ee423,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG nova.objects.instance [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'pci_devices' on Instance uuid d5fe6095-7bc6-48ae-b858-5ea2148ee423 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:56:20 user nova-compute[75993]:   <uuid>d5fe6095-7bc6-48ae-b858-5ea2148ee423</uuid>
Nov 08 21:56:20 user nova-compute[75993]:   <name>instance-00000021</name>
Nov 08 21:56:20 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:56:20 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:56:20 user nova-compute[75993]:   <metadata>
Nov 08 21:56:20 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:56:20 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:56:20 user nova-compute[75993]:       <nova:name>tempest-ServerActionsTestOtherA-server-1836352422</nova:name>
Nov 08 21:56:20 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:56:19</nova:creationTime>
Nov 08 21:56:20 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:56:20 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:56:20 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:56:20 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:56:20 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:56:20 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:56:20 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:56:20 user nova-compute[75993]:       <nova:owner>
Nov 08 21:56:20 user nova-compute[75993]:         <nova:user uuid="24c7a7bdeeda41339b11c9e9e1ad4c8d">tempest-ServerActionsTestOtherA-1530278199-project-member</nova:user>
Nov 08 21:56:20 user nova-compute[75993]:         <nova:project uuid="696fc6c404c244ccba1a90b11e5437de">tempest-ServerActionsTestOtherA-1530278199</nova:project>
Nov 08 21:56:20 user nova-compute[75993]:       </nova:owner>
Nov 08 21:56:20 user nova-compute[75993]:       <nova:ports>
Nov 08 21:56:20 user nova-compute[75993]:         <nova:port uuid="817baf15-2d4e-4d79-ab15-e70b6317cf5a">
Nov 08 21:56:20 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 21:56:20 user nova-compute[75993]:         </nova:port>
Nov 08 21:56:20 user nova-compute[75993]:       </nova:ports>
Nov 08 21:56:20 user nova-compute[75993]:     </nova:instance>
Nov 08 21:56:20 user nova-compute[75993]:   </metadata>
Nov 08 21:56:20 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:56:20 user nova-compute[75993]:     <system>
Nov 08 21:56:20 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:56:20 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:56:20 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:56:20 user nova-compute[75993]:       <entry name="serial">d5fe6095-7bc6-48ae-b858-5ea2148ee423</entry>
Nov 08 21:56:20 user nova-compute[75993]:       <entry name="uuid">d5fe6095-7bc6-48ae-b858-5ea2148ee423</entry>
Nov 08 21:56:20 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:56:20 user nova-compute[75993]:     </system>
Nov 08 21:56:20 user nova-compute[75993]:   </sysinfo>
Nov 08 21:56:20 user nova-compute[75993]:   <os>
Nov 08 21:56:20 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:56:20 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:56:20 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:56:20 user nova-compute[75993]:   </os>
Nov 08 21:56:20 user nova-compute[75993]:   <features>
Nov 08 21:56:20 user nova-compute[75993]:     <acpi/>
Nov 08 21:56:20 user nova-compute[75993]:     <apic/>
Nov 08 21:56:20 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:56:20 user nova-compute[75993]:   </features>
Nov 08 21:56:20 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:56:20 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:56:20 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:56:20 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:56:20 user nova-compute[75993]:   </clock>
Nov 08 21:56:20 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:56:20 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:56:20 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:56:20 user nova-compute[75993]:   </cpu>
Nov 08 21:56:20 user nova-compute[75993]:   <devices>
Nov 08 21:56:20 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:56:20 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:56:20 user nova-compute[75993]:       <source dev="/dev/sde"/>
Nov 08 21:56:20 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:56:20 user nova-compute[75993]:       <serial>d066025e-5c4a-478d-b7c8-4b70449486e4</serial>
Nov 08 21:56:20 user nova-compute[75993]:     </disk>
Nov 08 21:56:20 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:56:20 user nova-compute[75993]:       <mac address="fa:16:3e:6c:a3:fa"/>
Nov 08 21:56:20 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:56:20 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:56:20 user nova-compute[75993]:       <target dev="tap817baf15-2d"/>
Nov 08 21:56:20 user nova-compute[75993]:     </interface>
Nov 08 21:56:20 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:56:20 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/d5fe6095-7bc6-48ae-b858-5ea2148ee423/console.log" append="off"/>
Nov 08 21:56:20 user nova-compute[75993]:     </serial>
Nov 08 21:56:20 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:56:20 user nova-compute[75993]:     <video>
Nov 08 21:56:20 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:56:20 user nova-compute[75993]:     </video>
Nov 08 21:56:20 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:56:20 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:56:20 user nova-compute[75993]:     </rng>
Nov 08 21:56:20 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:56:20 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:56:20 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:56:20 user nova-compute[75993]:     </memballoon>
Nov 08 21:56:20 user nova-compute[75993]:   </devices>
Nov 08 21:56:20 user nova-compute[75993]: </domain>
Nov 08 21:56:20 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836352422',display_name='tempest-ServerActionsTestOtherA-server-1836352422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836352422',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIbQxx7DuVFUAXtivYRWFOk6i/ACW0OwEKdIgB2j1c2VjAAObwQ9qWcNKT6+OGS47GK/q93vubsJMppLLdAeY5qiAyBaCE0GMrdNogpncAZOwVmmfngYFO0ELy5AfYiWQ==',key_name='tempest-keypair-1988537750',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-ep0z5zdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:55:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=d5fe6095-7bc6-48ae-b858-5ea2148ee423,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG os_vif [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '741c652a-2766-5159-8444-73ad8038a04d', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap817baf15-2d, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap817baf15-2d, col_values=(('qos', UUID('492dc5fd-bfcf-4f28-8543-5d3f7c2cc302')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap817baf15-2d, col_values=(('external_ids', {'iface-id': '817baf15-2d4e-4d79-ab15-e70b6317cf5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:a3:fa', 'vm-uuid': 'd5fe6095-7bc6-48ae-b858-5ea2148ee423'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:20 user nova-compute[75993]: INFO os_vif [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d')
Nov 08 21:56:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:56:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No VIF found with MAC fa:16:3e:6c:a3:fa, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:56:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-918ebaf9-31ca-423f-9877-9c59b152b6e0 req-3e2bacc4-9298-4153-801c-9452f592c823 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:56:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-918ebaf9-31ca-423f-9877-9c59b152b6e0 req-3e2bacc4-9298-4153-801c-9452f592c823 service nova] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:56:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-918ebaf9-31ca-423f-9877-9c59b152b6e0 req-3e2bacc4-9298-4153-801c-9452f592c823 service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:56:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-918ebaf9-31ca-423f-9877-9c59b152b6e0 req-3e2bacc4-9298-4153-801c-9452f592c823 service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:56:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-918ebaf9-31ca-423f-9877-9c59b152b6e0 req-3e2bacc4-9298-4153-801c-9452f592c823 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] No waiting events found dispatching network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:56:22 user nova-compute[75993]: WARNING nova.compute.manager [req-918ebaf9-31ca-423f-9877-9c59b152b6e0 req-3e2bacc4-9298-4153-801c-9452f592c823 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received unexpected event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a for instance with vm_state building and task_state spawning.
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:56:24 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Instance spawned successfully.
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:24 user nova-compute[75993]: INFO nova.compute.manager [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Took 5.52 seconds to spawn the instance on the hypervisor.
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:56:24 user nova-compute[75993]: INFO nova.compute.manager [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Took 33.91 seconds to build instance.
Nov 08 21:56:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5b5ac785-9df6-499d-ba97-e754f296d2e0 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.022s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-33380c36-ce73-4581-9f67-380b8cb60dab req-b6af6473-2a3c-4da7-aa87-6fe2e9da6e25 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33380c36-ce73-4581-9f67-380b8cb60dab req-b6af6473-2a3c-4da7-aa87-6fe2e9da6e25 service nova] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33380c36-ce73-4581-9f67-380b8cb60dab req-b6af6473-2a3c-4da7-aa87-6fe2e9da6e25 service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-33380c36-ce73-4581-9f67-380b8cb60dab req-b6af6473-2a3c-4da7-aa87-6fe2e9da6e25 service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:56:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-33380c36-ce73-4581-9f67-380b8cb60dab req-b6af6473-2a3c-4da7-aa87-6fe2e9da6e25 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] No waiting events found dispatching network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:56:24 user nova-compute[75993]: WARNING nova.compute.manager [req-33380c36-ce73-4581-9f67-380b8cb60dab req-b6af6473-2a3c-4da7-aa87-6fe2e9da6e25 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received unexpected event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a for instance with vm_state active and task_state None.
Nov 08 21:56:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:37 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 is timed out.
Nov 08 21:56:37 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Successfully detached device vdb from instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 from the live domain config.
Nov 08 21:56:37 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:56:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FBqjPKRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:56:37 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:56:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:56:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:56:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9955cc1-954b-406d-8389-82af28bf2727]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:56:38 user nova-compute[75993]: No targets found.
Nov 08 21:56:38 user nova-compute[75993]: iSNS:
Nov 08 21:56:38 user nova-compute[75993]: No targets found.
Nov 08 21:56:38 user nova-compute[75993]: STATIC:
Nov 08 21:56:38 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:56:38 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:56:38 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:56:38 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d
Nov 08 21:56:38 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:56:38 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:56:38 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4
Nov 08 21:56:38 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:56:38 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:56:38 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676
Nov 08 21:56:38 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:56:38 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:56:38 user nova-compute[75993]: FIRMWARE:
Nov 08 21:56:38 user nova-compute[75993]: No targets found.
Nov 08 21:56:38 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:56:38 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:56:38 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb1de42-1b08-419f-96af-2a128c2f1bf9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[43583112-914f-413c-8e5c-10b95d9032ef]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:56:38 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:56:38 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:56:38 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:56:38 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:56:38 user nova-compute[75993]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 (non-flash)
Nov 08 21:56:38 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:56:38 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:56:38 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f85684675b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cddb30-4c31-48e6-88ba-cdc21fb1f626]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2173b17c-9ac9-4fcc-86d7-c4f6f3e3f741]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[79311a52-f87f-4fb1-9bb4-d1fb40b0258d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[857d201c-e52a-409a-83f7-41aebd408cd5]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb44449-7acb-4883-a422-a48060983530]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51cc095-232d-4ada-bb9b-5de1c49e9f8b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260]
Nov 08 21:56:38 user nova-compute[75993]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676, portal: 172.16.0.220,3260] successful.
Nov 08 21:56:38 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16576d6c-8af1-4e46-b05c-44547d841676 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ee39ac-05dd-4230-b947-4928ae54fe76]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] <== disconnect_volume: return (337ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:56:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:56:39 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'flavor' on Instance uuid 42555213-8dfd-4b93-8827-2b72ae3ca2e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:56:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f3e9b617-e5f5-4d87-8654-2a989b72a377 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.483s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:56:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:56:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:56:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:56:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:56:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:56:48 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:56:48 user nova-compute[75993]: INFO nova.compute.claims [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Claim successful on node user
Nov 08 21:56:48 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:56:48 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:56:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:56:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:56:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:56:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:56:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:56:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG nova.policy [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55e7e193334f4d83949bf4119b71661c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482c9b5155b94bb1a5f1189ffc0c9cdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:56:49 user nova-compute[75993]: INFO nova.virt.block_device [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Booting with volume 32658f8f-79d5-4fec-8cc0-db9c0142af76 at /dev/vda
Nov 08 21:56:49 user nova-compute[75993]: DEBUG os_brick.utils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[868bc1dd-1ef2-42b9-be78-f3363f77176a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd1c464-cb2b-496c-aacc-15d8247f99dc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0e4e04-6458-4c60-8b8c-f7e8a9d9955c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f471ad1-0ffa-480d-955c-9293aa23108c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:56:49 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:56:49 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[229faa33-889e-419f-81e8-c98a12f63674]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG os_brick.utils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating existing volume attachment record: 312d1e10-8a6b-452b-a572-1a6011dd9961 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 21:56:49 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Successfully created port: fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:56:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Successfully updated port: fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquired lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-bd4557a5-0067-4b4e-8bff-82d4db01d8b1 req-f2399762-44b4-4262-8f2b-cda33c712526 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-changed-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-bd4557a5-0067-4b4e-8bff-82d4db01d8b1 req-f2399762-44b4-4262-8f2b-cda33c712526 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Refreshing instance network info cache due to event network-changed-fe2d45f6-7eff-41c3-b47d-7f499f73bf33. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bd4557a5-0067-4b4e-8bff-82d4db01d8b1 req-f2399762-44b4-4262-8f2b-cda33c712526 service nova] Acquiring lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating instance_info_cache with network_info: [{"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Releasing lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Instance network_info: |[{"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bd4557a5-0067-4b4e-8bff-82d4db01d8b1 req-f2399762-44b4-4262-8f2b-cda33c712526 service nova] Acquired lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:56:51 user nova-compute[75993]: DEBUG nova.network.neutron [req-bd4557a5-0067-4b4e-8bff-82d4db01d8b1 req-f2399762-44b4-4262-8f2b-cda33c712526 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Refreshing network info cache for port fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:56:52 user nova-compute[75993]: DEBUG nova.network.neutron [req-bd4557a5-0067-4b4e-8bff-82d4db01d8b1 req-f2399762-44b4-4262-8f2b-cda33c712526 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updated VIF entry in instance network info cache for port fe2d45f6-7eff-41c3-b47d-7f499f73bf33. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:56:52 user nova-compute[75993]: DEBUG nova.network.neutron [req-bd4557a5-0067-4b4e-8bff-82d4db01d8b1 req-f2399762-44b4-4262-8f2b-cda33c712526 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating instance_info_cache with network_info: [{"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:56:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bd4557a5-0067-4b4e-8bff-82d4db01d8b1 req-f2399762-44b4-4262-8f2b-cda33c712526 service nova] Releasing lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:56:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:56:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:02 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:57:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:57:07 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:57:07 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:57:07 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:57:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:07 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:57:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:57:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:09 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:57:09 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:57:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8068MB free_disk=24.9857177734375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d5fe6095-7bc6-48ae-b858-5ea2148ee423 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 3713db24-c1c7-4755-b94f-ec88b1fbc960 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:57:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:57:10 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:57:10 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:57:10 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:57:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:57:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:57:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:57:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:57:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:57:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:57:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updating instance_info_cache with network_info: [{"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:57:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-42555213-8dfd-4b93-8827-2b72ae3ca2e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:57:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:57:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:57:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:57:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:57:13 user nova-compute[75993]: INFO nova.compute.manager [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Rescuing
Nov 08 21:57:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:57:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquired lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:57:13 user nova-compute[75993]: DEBUG nova.network.neutron [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:57:13 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:57:13 user nova-compute[75993]: DEBUG nova.network.neutron [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Updating instance_info_cache with network_info: [{"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:57:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Releasing lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:57:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Creating image(s)
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Ensure instance console log exists: /opt/stack/data/nova/instances/3713db24-c1c7-4755-b94f-ec88b1fbc960/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Start _get_guest_xml network_info=[{"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '312d1e10-8a6b-452b-a572-1a6011dd9961', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXNAgQDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3713db24-c1c7-4755-b94f-ec88b1fbc960', 'attached_at': '', 'detached_at': '', 'volume_id': '32658f8f-79d5-4fec-8cc0-db9c0142af76', 'serial': '32658f8f-79d5-4fec-8cc0-db9c0142af76'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:57:14 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:57:14 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXNAgQDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:57:14 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:57:14 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:57:14 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[34906c26-36bc-4006-882f-73c7a174b01e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:57:14 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[69718d91-2d6c-40c2-b7ae-6aaab38d7973]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76] added
Nov 08 21:57:14 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d19e55b-7f46-4752-92c8-8f4e62a98311 req-955e9999-cdd3-470a-a37f-9daca0e8881a service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-unplugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d19e55b-7f46-4752-92c8-8f4e62a98311 req-955e9999-cdd3-470a-a37f-9daca0e8881a service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d19e55b-7f46-4752-92c8-8f4e62a98311 req-955e9999-cdd3-470a-a37f-9daca0e8881a service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5d19e55b-7f46-4752-92c8-8f4e62a98311 req-955e9999-cdd3-470a-a37f-9daca0e8881a service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-5d19e55b-7f46-4752-92c8-8f4e62a98311 req-955e9999-cdd3-470a-a37f-9daca0e8881a service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-unplugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:57:14 user nova-compute[75993]: WARNING nova.compute.manager [req-5d19e55b-7f46-4752-92c8-8f4e62a98311 req-955e9999-cdd3-470a-a37f-9daca0e8881a service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received unexpected event network-vif-unplugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with vm_state active and task_state rescuing.
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[591ba671-9200-4f17-ac1f-eff2374d3259]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.080s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d399470d-47fd-424b-ba8e-6543fd2ef676]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXNAgQDb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXNAgQDb" returned: 0 in 0.100s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e050af97-2211-47c8-86e4-ede109255b44]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FXNAgQDb'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56a80b8-04bc-41fc-bfb2-2c8b1b752095]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f814ff4-a9e5-41b6-b7a9-9aa8df7d77da]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:57:14 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:57:14 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:57:14 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:57:14 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:57:14 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:57:14 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Instance destroyed successfully.
Nov 08 21:57:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Attempting a stable device rescue
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75993) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Instance directory exists: not creating {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 21:57:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Creating image(s)
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "/opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "/opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "790137ef2606763113e0887a0fb705ccfb97f0f5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "790137ef2606763113e0887a0fb705ccfb97f0f5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:57:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5.part --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --login" returned: 0 in 1.158s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e858ca8-c7e0-439c-9b57-8fbfd88baf7a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260]
Nov 08 21:57:16 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260] successful.
Nov 08 21:57:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a5fa2e-bc75-4a40-b861-0296ad51a013]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c60302-3b88-4299-824b-c72b9c2446d1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:57:16 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:57:16 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:57:16 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:57:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:57:16 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:57:16 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:57:16 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:57:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.956s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e57ba-5f2b-4858-97fd-62cd36e0e83f]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXNAgQDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5.part --force-share --output=json" returned: 0 in 0.226s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG nova.virt.images [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] 3ce534ea-0fec-4b3f-82d8-f2d77e0ade93 was qcow2, converting to raw {{(pid=75993) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5.part /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5.converted {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-0976e86b-ac17-473f-99dc-b3ff24f3a27c req-5ae9177f-6882-4f48-9d3c-74b8d5237ae7 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0976e86b-ac17-473f-99dc-b3ff24f3a27c req-5ae9177f-6882-4f48-9d3c-74b8d5237ae7 service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0976e86b-ac17-473f-99dc-b3ff24f3a27c req-5ae9177f-6882-4f48-9d3c-74b8d5237ae7 service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0976e86b-ac17-473f-99dc-b3ff24f3a27c req-5ae9177f-6882-4f48-9d3c-74b8d5237ae7 service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-0976e86b-ac17-473f-99dc-b3ff24f3a27c req-5ae9177f-6882-4f48-9d3c-74b8d5237ae7 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:57:16 user nova-compute[75993]: WARNING nova.compute.manager [req-0976e86b-ac17-473f-99dc-b3ff24f3a27c req-5ae9177f-6882-4f48-9d3c-74b8d5237ae7 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received unexpected event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with vm_state active and task_state rescuing.
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5.part /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5.converted" returned: 0 in 0.406s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5.converted --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "790137ef2606763113e0887a0fb705ccfb97f0f5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.985s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "790137ef2606763113e0887a0fb705ccfb97f0f5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "790137ef2606763113e0887a0fb705ccfb97f0f5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5 --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5,backing_fmt=raw /opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/disk.rescue {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5,backing_fmt=raw /opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/disk.rescue" returned: 0 in 0.080s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.999s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] <== connect_volume: return (3001ms) {'type': 'block', 'scsi_wwn': '23733366535633866', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733366535633866', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "790137ef2606763113e0887a0fb705ccfb97f0f5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'migration_context' on Instance uuid d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1289890038',display_name='tempest-TestShelveInstance-server-1289890038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1289890038',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYpfKFamOS8ZmffOZUH83SooiZofpo/zMgwflGnwGStjsdQwy4OitgGLlVKVUnTQ7qUq17P715+FUnTYTZWPElqsI7SoOWfJ4AQYQyb7Tt1NxCTzAFKHzDPudlIcSfDzw==',key_name='tempest-TestShelveInstance-243862016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482c9b5155b94bb1a5f1189ffc0c9cdc',ramdisk_id='',reservation_id='r-p0nylb07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-510215546',owner_user_name='tempest-TestShelveInstance-510215546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:56:49Z,user_data=None,user_id='55e7e193334f4d83949bf4119b71661c',uuid=3713db24-c1c7-4755-b94f-ec88b1fbc960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converting VIF {"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.objects.instance [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lazy-loading 'pci_devices' on Instance uuid 3713db24-c1c7-4755-b94f-ec88b1fbc960 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.objects.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Object Instance<d4f0f927-23ad-4f92-acbb-cf6757f9c4e9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Start _get_guest_xml network_info=[{"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "vif_mac": "fa:16:3e:00:f6:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3ce534ea-0fec-4b3f-82d8-f2d77e0ade93', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '090c71d1-5600-4b94-a7cd-a62b884cc393', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCqrJaId', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd4f0f927-23ad-4f92-acbb-cf6757f9c4e9', 'attached_at': '', 'detached_at': '', 'volume_id': '5c697987-9d0d-43f4-9772-a6b24a15559d', 'serial': '5c697987-9d0d-43f4-9772-a6b24a15559d'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'resources' on Instance uuid d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:57:17 user nova-compute[75993]:   <uuid>3713db24-c1c7-4755-b94f-ec88b1fbc960</uuid>
Nov 08 21:57:17 user nova-compute[75993]:   <name>instance-00000022</name>
Nov 08 21:57:17 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:57:17 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:57:17 user nova-compute[75993]:   <metadata>
Nov 08 21:57:17 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:57:17 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:57:17 user nova-compute[75993]:       <nova:name>tempest-TestShelveInstance-server-1289890038</nova:name>
Nov 08 21:57:17 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:57:14</nova:creationTime>
Nov 08 21:57:17 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:57:17 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:57:17 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:57:17 user nova-compute[75993]:       <nova:owner>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:user uuid="55e7e193334f4d83949bf4119b71661c">tempest-TestShelveInstance-510215546-project-member</nova:user>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:project uuid="482c9b5155b94bb1a5f1189ffc0c9cdc">tempest-TestShelveInstance-510215546</nova:project>
Nov 08 21:57:17 user nova-compute[75993]:       </nova:owner>
Nov 08 21:57:17 user nova-compute[75993]:       <nova:ports>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:port uuid="fe2d45f6-7eff-41c3-b47d-7f499f73bf33">
Nov 08 21:57:17 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 21:57:17 user nova-compute[75993]:         </nova:port>
Nov 08 21:57:17 user nova-compute[75993]:       </nova:ports>
Nov 08 21:57:17 user nova-compute[75993]:     </nova:instance>
Nov 08 21:57:17 user nova-compute[75993]:   </metadata>
Nov 08 21:57:17 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:57:17 user nova-compute[75993]:     <system>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="serial">3713db24-c1c7-4755-b94f-ec88b1fbc960</entry>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="uuid">3713db24-c1c7-4755-b94f-ec88b1fbc960</entry>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:57:17 user nova-compute[75993]:     </system>
Nov 08 21:57:17 user nova-compute[75993]:   </sysinfo>
Nov 08 21:57:17 user nova-compute[75993]:   <os>
Nov 08 21:57:17 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:57:17 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:57:17 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:57:17 user nova-compute[75993]:   </os>
Nov 08 21:57:17 user nova-compute[75993]:   <features>
Nov 08 21:57:17 user nova-compute[75993]:     <acpi/>
Nov 08 21:57:17 user nova-compute[75993]:     <apic/>
Nov 08 21:57:17 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:57:17 user nova-compute[75993]:   </features>
Nov 08 21:57:17 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:57:17 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:57:17 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:57:17 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:57:17 user nova-compute[75993]:   </clock>
Nov 08 21:57:17 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:57:17 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:57:17 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:57:17 user nova-compute[75993]:   </cpu>
Nov 08 21:57:17 user nova-compute[75993]:   <devices>
Nov 08 21:57:17 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:57:17 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:57:17 user nova-compute[75993]:       <source dev="/dev/sdc"/>
Nov 08 21:57:17 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:57:17 user nova-compute[75993]:       <serial>32658f8f-79d5-4fec-8cc0-db9c0142af76</serial>
Nov 08 21:57:17 user nova-compute[75993]:     </disk>
Nov 08 21:57:17 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:57:17 user nova-compute[75993]:       <mac address="fa:16:3e:c5:06:b5"/>
Nov 08 21:57:17 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:57:17 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:57:17 user nova-compute[75993]:       <target dev="tapfe2d45f6-7e"/>
Nov 08 21:57:17 user nova-compute[75993]:     </interface>
Nov 08 21:57:17 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:57:17 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/3713db24-c1c7-4755-b94f-ec88b1fbc960/console.log" append="off"/>
Nov 08 21:57:17 user nova-compute[75993]:     </serial>
Nov 08 21:57:17 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:57:17 user nova-compute[75993]:     <video>
Nov 08 21:57:17 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:57:17 user nova-compute[75993]:     </video>
Nov 08 21:57:17 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:57:17 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:57:17 user nova-compute[75993]:     </rng>
Nov 08 21:57:17 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:57:17 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:57:17 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:57:17 user nova-compute[75993]:     </memballoon>
Nov 08 21:57:17 user nova-compute[75993]:   </devices>
Nov 08 21:57:17 user nova-compute[75993]: </domain>
Nov 08 21:57:17 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1289890038',display_name='tempest-TestShelveInstance-server-1289890038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1289890038',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYpfKFamOS8ZmffOZUH83SooiZofpo/zMgwflGnwGStjsdQwy4OitgGLlVKVUnTQ7qUq17P715+FUnTYTZWPElqsI7SoOWfJ4AQYQyb7Tt1NxCTzAFKHzDPudlIcSfDzw==',key_name='tempest-TestShelveInstance-243862016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482c9b5155b94bb1a5f1189ffc0c9cdc',ramdisk_id='',reservation_id='r-p0nylb07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-510215546',owner_user_name='tempest-TestShelveInstance-510215546-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:56:49Z,user_data=None,user_id='55e7e193334f4d83949bf4119b71661c',uuid=3713db24-c1c7-4755-b94f-ec88b1fbc960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converting VIF {"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_vif [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9db3ac7c-bbc4-5eb5-aac4-ef32c94720e7', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.objects.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Object Instance<d4f0f927-23ad-4f92-acbb-cf6757f9c4e9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'numa_topology' on Instance uuid d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe2d45f6-7e, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe2d45f6-7e, col_values=(('qos', UUID('c113802d-ab41-4e65-a2a4-36b09ddf67e4')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe2d45f6-7e, col_values=(('external_ids', {'iface-id': 'fe2d45f6-7eff-41c3-b47d-7f499f73bf33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:06:b5', 'vm-uuid': '3713db24-c1c7-4755-b94f-ec88b1fbc960'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.objects.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Object Instance<d4f0f927-23ad-4f92-acbb-cf6757f9c4e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:57:17 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:57:17 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:17 user nova-compute[75993]: INFO os_vif [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e')
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.objects.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Object Instance<d4f0f927-23ad-4f92-acbb-cf6757f9c4e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCqrJaId', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:57:17 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:57:17 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:57:17 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1882298-d784-4a48-bfb9-a40dcfd82986]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YCqrJaId\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 08 21:57:17 user nova-compute[75993]: node.name = iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d
Nov 08 21:57:17 user nova-compute[75993]: node.tpgt = -1
Nov 08 21:57:17 user nova-compute[75993]: node.startup = automatic
Nov 08 21:57:17 user nova-compute[75993]: node.leading_login = No
Nov 08 21:57:17 user nova-compute[75993]: iface.iscsi_ifacename = default
Nov 08 21:57:17 user nova-compute[75993]: iface.net_ifacename = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.ipaddress = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.prefix_len = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.hwaddress = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.transport_name = tcp
Nov 08 21:57:17 user nova-compute[75993]: iface.initiatorname = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.state = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.vlan_id = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.vlan_priority = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.vlan_state = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.iface_num = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.mtu = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.port = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.bootproto = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.subnet_mask = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.gateway = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.dhcp_alt_client_id_state = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.dhcp_alt_client_id = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.dhcp_dns = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.dhcp_learn_iqn = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.dhcp_req_vendor_id_state = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.dhcp_vendor_id_state = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.dhcp_vendor_id = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.dhcp_slp_da = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.fragmentation = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.gratuitous_arp = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.incoming_forwarding = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.tos_state = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.tos = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.ttl = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.delayed_ack = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.tcp_nagle = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.tcp_wsf_state = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.tcp_wsf = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.tcp_timer_scale = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.tcp_timestamp = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.redirect = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.def_task_mgmt_timeout = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.header_digest = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.data_digest = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.immediate_data = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.initial_r2t = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.data_seq_inorder = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.data_pdu_inorder = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.erl = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.max_receive_data_len = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.first_burst_len = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.max_outstanding_r2t = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.max_burst_len = 0
Nov 08 21:57:17 user nova-compute[75993]: iface.chap_auth = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.bidi_chap = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.strict_login_compliance = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.discovery_auth = <empty>
Nov 08 21:57:17 user nova-compute[75993]: iface.discovery_logout = <empty>
Nov 08 21:57:17 user nova-compute[75993]: node.discovery_address = <empty>
Nov 08 21:57:17 user nova-compute[75993]: node.discovery_port = 0
Nov 08 21:57:17 user nova-compute[75993]: node.discovery_type = static
Nov 08 21:57:17 user nova-compute[75993]: node.session.initial_cmdsn = 0
Nov 08 21:57:17 user nova-compute[75993]: node.session.initial_login_retry_max = 8
Nov 08 21:57:17 user nova-compute[75993]: node.session.xmit_thread_priority = -20
Nov 08 21:57:17 user nova-compute[75993]: node.session.cmds_max = 128
Nov 08 21:57:17 user nova-compute[75993]: node.session.queue_depth = 32
Nov 08 21:57:17 user nova-compute[75993]: node.session.nr_sessions = 1
Nov 08 21:57:17 user nova-compute[75993]: node.session.auth.authmethod = CHAP
Nov 08 21:57:17 user nova-compute[75993]: node.session.auth.username = YCqrJaId
Nov 08 21:57:17 user nova-compute[75993]: node.session.auth.password = ***
Nov 08 21:57:17 user nova-compute[75993]: node.session.auth.username_in = <empty>
Nov 08 21:57:17 user nova-compute[75993]: node.session.auth.password_in = <empty>
Nov 08 21:57:17 user nova-compute[75993]: node.session.auth.chap_algs = MD5
Nov 08 21:57:17 user nova-compute[75993]: node.session.timeo.replacement_timeout = 120
Nov 08 21:57:17 user nova-compute[75993]: node.session.err_timeo.abort_timeout = 15
Nov 08 21:57:17 user nova-compute[75993]: node.session.err_timeo.lu_reset_timeout = 30
Nov 08 21:57:17 user nova-compute[75993]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 08 21:57:17 user nova-compute[75993]: node.session.err_timeo.host_reset_timeout = 60
Nov 08 21:57:17 user nova-compute[75993]: node.session.iscsi.FastAbort = Yes
Nov 08 21:57:17 user nova-compute[75993]: node.session.iscsi.InitialR2T = No
Nov 08 21:57:17 user nova-compute[75993]: node.session.iscsi.ImmediateData = Yes
Nov 08 21:57:17 user nova-compute[75993]: node.session.iscsi.FirstBurstLength = 262144
Nov 08 21:57:17 user nova-compute[75993]: node.session.iscsi.MaxBurstLength = 16776192
Nov 08 21:57:17 user nova-compute[75993]: node.session.iscsi.DefaultTime2Retain = 0
Nov 08 21:57:17 user nova-compute[75993]: node.session.iscsi.DefaultTime2Wait = 2
Nov 08 21:57:17 user nova-compute[75993]: node.session.iscsi.MaxConnections = 1
Nov 08 21:57:17 user nova-compute[75993]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 08 21:57:17 user nova-compute[75993]: node.session.iscsi.ERL = 0
Nov 08 21:57:17 user nova-compute[75993]: node.session.scan = manual
Nov 08 21:57:17 user nova-compute[75993]: node.session.reopen_max = 0
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].address = 172.16.0.220
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].port = 3260
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].startup = manual
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].tcp.window_size = 524288
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].tcp.type_of_service = 0
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].timeo.logout_timeout = 15
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].timeo.login_timeout = 15
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].timeo.auth_timeout = 45
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].timeo.noop_out_interval = 5
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].timeo.noop_out_timeout = 5
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].iscsi.HeaderDigest = None
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].iscsi.DataDigest = None
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].iscsi.IFMarker = No
Nov 08 21:57:17 user nova-compute[75993]: node.conn[0].iscsi.OFMarker = No
Nov 08 21:57:17 user nova-compute[75993]: # END RECORD
Nov 08 21:57:17 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] No VIF found with MAC fa:16:3e:c5:06:b5, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af7cbba-4aa6-4e28-9279-d1c79d257ec2]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89cd799-dc84-4726-a84c-f36048fe4863]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCqrJaId {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YCqrJaId" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c573fe-ff9e-4601-95d6-0af7a73e1db3]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YCqrJaId'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.048s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d263ec5b-527a-4dc0-96b5-0395114d71cb]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf4595-a956-486c-9a24-1948f99efadb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:57:17 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:57:17 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:57:17 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:57:17 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:57:17 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:57:17 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:57:17 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:57:17 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.197s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] HCTL ('33', '0', '0', 0) found on session 39 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[28291a0a-89b1-475b-9684-e49dea64c99a]: (4, ('0 0 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Searching for a device in session 39 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCqrJaId', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.223s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] <== connect_volume: return (224ms) {'type': 'block', 'scsi_wwn': '26134653161363662', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134653161363662', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1834406264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1834406264',id=32,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:55:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-4tl9r080',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:55:27Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=d4f0f927-23ad-4f92-acbb-cf6757f9c4e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "vif_mac": "fa:16:3e:00:f6:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "vif_mac": "fa:16:3e:00:f6:55"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:f6:55,bridge_name='br-int',has_traffic_filtering=True,id=cafc456a-96ff-4e51-b0d5-9237991809c7,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafc456a-96') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'pci_devices' on Instance uuid d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.objects.base [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Object Instance<d4f0f927-23ad-4f92-acbb-cf6757f9c4e9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:57:17 user nova-compute[75993]:   <uuid>d4f0f927-23ad-4f92-acbb-cf6757f9c4e9</uuid>
Nov 08 21:57:17 user nova-compute[75993]:   <name>instance-00000020</name>
Nov 08 21:57:17 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:57:17 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:57:17 user nova-compute[75993]:   <metadata>
Nov 08 21:57:17 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:57:17 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:57:17 user nova-compute[75993]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1834406264</nova:name>
Nov 08 21:57:17 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:57:17</nova:creationTime>
Nov 08 21:57:17 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:57:17 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:57:17 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:57:17 user nova-compute[75993]:       <nova:owner>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:user uuid="78965be8230646288b7fc0443c3f4f6c">tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member</nova:user>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:project uuid="fb1547c59f8e4d85ad6f650b01243357">tempest-ServerBootFromVolumeStableRescueTest-571934265</nova:project>
Nov 08 21:57:17 user nova-compute[75993]:       </nova:owner>
Nov 08 21:57:17 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:57:17 user nova-compute[75993]:       <nova:ports>
Nov 08 21:57:17 user nova-compute[75993]:         <nova:port uuid="cafc456a-96ff-4e51-b0d5-9237991809c7">
Nov 08 21:57:17 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 21:57:17 user nova-compute[75993]:         </nova:port>
Nov 08 21:57:17 user nova-compute[75993]:       </nova:ports>
Nov 08 21:57:17 user nova-compute[75993]:     </nova:instance>
Nov 08 21:57:17 user nova-compute[75993]:   </metadata>
Nov 08 21:57:17 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:57:17 user nova-compute[75993]:     <system>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="serial">d4f0f927-23ad-4f92-acbb-cf6757f9c4e9</entry>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="uuid">d4f0f927-23ad-4f92-acbb-cf6757f9c4e9</entry>
Nov 08 21:57:17 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:57:17 user nova-compute[75993]:     </system>
Nov 08 21:57:17 user nova-compute[75993]:   </sysinfo>
Nov 08 21:57:17 user nova-compute[75993]:   <os>
Nov 08 21:57:17 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:57:17 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:57:17 user nova-compute[75993]:   </os>
Nov 08 21:57:17 user nova-compute[75993]:   <features>
Nov 08 21:57:17 user nova-compute[75993]:     <acpi/>
Nov 08 21:57:17 user nova-compute[75993]:     <apic/>
Nov 08 21:57:17 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:57:17 user nova-compute[75993]:   </features>
Nov 08 21:57:17 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:57:17 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:57:17 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:57:17 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:57:17 user nova-compute[75993]:   </clock>
Nov 08 21:57:17 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:57:17 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:57:17 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:57:17 user nova-compute[75993]:   </cpu>
Nov 08 21:57:17 user nova-compute[75993]:   <devices>
Nov 08 21:57:17 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:57:17 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:57:17 user nova-compute[75993]:       <source dev="/dev/sdb"/>
Nov 08 21:57:17 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:57:17 user nova-compute[75993]:       <serial>5c697987-9d0d-43f4-9772-a6b24a15559d</serial>
Nov 08 21:57:17 user nova-compute[75993]:     </disk>
Nov 08 21:57:17 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:57:17 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:57:17 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/disk.rescue"/>
Nov 08 21:57:17 user nova-compute[75993]:       <target dev="vdb" bus="virtio"/>
Nov 08 21:57:17 user nova-compute[75993]:       <boot order="1"/>
Nov 08 21:57:17 user nova-compute[75993]:     </disk>
Nov 08 21:57:17 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:57:17 user nova-compute[75993]:       <mac address="fa:16:3e:00:f6:55"/>
Nov 08 21:57:17 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:57:17 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:57:17 user nova-compute[75993]:       <target dev="tapcafc456a-96"/>
Nov 08 21:57:17 user nova-compute[75993]:     </interface>
Nov 08 21:57:17 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:57:17 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/console.log" append="off"/>
Nov 08 21:57:17 user nova-compute[75993]:     </serial>
Nov 08 21:57:17 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:57:17 user nova-compute[75993]:     <video>
Nov 08 21:57:17 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:57:17 user nova-compute[75993]:     </video>
Nov 08 21:57:17 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:57:17 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:57:17 user nova-compute[75993]:     </rng>
Nov 08 21:57:17 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:57:17 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:57:17 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:57:17 user nova-compute[75993]:     </memballoon>
Nov 08 21:57:17 user nova-compute[75993]:   </devices>
Nov 08 21:57:17 user nova-compute[75993]: </domain>
Nov 08 21:57:17 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:57:17 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Instance destroyed successfully.
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:57:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] No VIF found with MAC fa:16:3e:00:f6:55, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:57:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-408e49a0-7368-44cd-9b61-413af126415e req-488da7f7-e84b-430b-9a0f-5e0f9cf0e05e service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-408e49a0-7368-44cd-9b61-413af126415e req-488da7f7-e84b-430b-9a0f-5e0f9cf0e05e service nova] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-408e49a0-7368-44cd-9b61-413af126415e req-488da7f7-e84b-430b-9a0f-5e0f9cf0e05e service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-408e49a0-7368-44cd-9b61-413af126415e req-488da7f7-e84b-430b-9a0f-5e0f9cf0e05e service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-408e49a0-7368-44cd-9b61-413af126415e req-488da7f7-e84b-430b-9a0f-5e0f9cf0e05e service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] No waiting events found dispatching network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:57:19 user nova-compute[75993]: WARNING nova.compute.manager [req-408e49a0-7368-44cd-9b61-413af126415e req-488da7f7-e84b-430b-9a0f-5e0f9cf0e05e service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received unexpected event network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 for instance with vm_state building and task_state spawning.
Nov 08 21:57:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-ea1f716f-8c76-427d-ac29-1d4a560fd16b req-b90e2cdf-0dd4-4d02-9612-73d6b054294b service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ea1f716f-8c76-427d-ac29-1d4a560fd16b req-b90e2cdf-0dd4-4d02-9612-73d6b054294b service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ea1f716f-8c76-427d-ac29-1d4a560fd16b req-b90e2cdf-0dd4-4d02-9612-73d6b054294b service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ea1f716f-8c76-427d-ac29-1d4a560fd16b req-b90e2cdf-0dd4-4d02-9612-73d6b054294b service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-ea1f716f-8c76-427d-ac29-1d4a560fd16b req-b90e2cdf-0dd4-4d02-9612-73d6b054294b service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:57:20 user nova-compute[75993]: WARNING nova.compute.manager [req-ea1f716f-8c76-427d-ac29-1d4a560fd16b req-b90e2cdf-0dd4-4d02-9612-73d6b054294b service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received unexpected event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with vm_state active and task_state rescuing.
Nov 08 21:57:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-973281ab-9274-4c74-a14a-f090eef91329 req-d6a36bfd-1de4-49b0-a229-5447e7f53aa3 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-973281ab-9274-4c74-a14a-f090eef91329 req-d6a36bfd-1de4-49b0-a229-5447e7f53aa3 service nova] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-973281ab-9274-4c74-a14a-f090eef91329 req-d6a36bfd-1de4-49b0-a229-5447e7f53aa3 service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-973281ab-9274-4c74-a14a-f090eef91329 req-d6a36bfd-1de4-49b0-a229-5447e7f53aa3 service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-973281ab-9274-4c74-a14a-f090eef91329 req-d6a36bfd-1de4-49b0-a229-5447e7f53aa3 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] No waiting events found dispatching network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:57:22 user nova-compute[75993]: WARNING nova.compute.manager [req-973281ab-9274-4c74-a14a-f090eef91329 req-d6a36bfd-1de4-49b0-a229-5447e7f53aa3 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received unexpected event network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 for instance with vm_state building and task_state spawning.
Nov 08 21:57:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-aa8d43c0-53af-4015-87cf-37301a21f2ef req-97deb787-ada2-414a-8dbf-d231f826136a service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-aa8d43c0-53af-4015-87cf-37301a21f2ef req-97deb787-ada2-414a-8dbf-d231f826136a service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-aa8d43c0-53af-4015-87cf-37301a21f2ef req-97deb787-ada2-414a-8dbf-d231f826136a service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-aa8d43c0-53af-4015-87cf-37301a21f2ef req-97deb787-ada2-414a-8dbf-d231f826136a service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-aa8d43c0-53af-4015-87cf-37301a21f2ef req-97deb787-ada2-414a-8dbf-d231f826136a service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:57:22 user nova-compute[75993]: WARNING nova.compute.manager [req-aa8d43c0-53af-4015-87cf-37301a21f2ef req-97deb787-ada2-414a-8dbf-d231f826136a service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received unexpected event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with vm_state active and task_state rescuing.
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3a6b9fd9-319b-4cd0-8db4-ccc5ba7496ec tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:57:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Instance spawned successfully.
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:57:22 user nova-compute[75993]: INFO nova.compute.manager [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Took 8.68 seconds to spawn the instance on the hypervisor.
Nov 08 21:57:22 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:57:22 user nova-compute[75993]: INFO nova.compute.manager [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Took 34.45 seconds to build instance.
Nov 08 21:57:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1a1e55b7-88ba-4983-a7f9-922271daae5b tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.572s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:31 user nova-compute[75993]: INFO nova.compute.manager [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Terminating instance
Nov 08 21:57:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-30eece9f-499d-4884-8cdc-555f88c9ab0a req-27ec273f-a127-4372-ab95-961591e3ffb2 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-unplugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-30eece9f-499d-4884-8cdc-555f88c9ab0a req-27ec273f-a127-4372-ab95-961591e3ffb2 service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-30eece9f-499d-4884-8cdc-555f88c9ab0a req-27ec273f-a127-4372-ab95-961591e3ffb2 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-30eece9f-499d-4884-8cdc-555f88c9ab0a req-27ec273f-a127-4372-ab95-961591e3ffb2 service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-30eece9f-499d-4884-8cdc-555f88c9ab0a req-27ec273f-a127-4372-ab95-961591e3ffb2 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-unplugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:57:31 user nova-compute[75993]: DEBUG nova.compute.manager [req-30eece9f-499d-4884-8cdc-555f88c9ab0a req-27ec273f-a127-4372-ab95-961591e3ffb2 service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-unplugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Instance destroyed successfully.
Nov 08 21:57:32 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'resources' on Instance uuid 42555213-8dfd-4b93-8827-2b72ae3ca2e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:51:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1820678847',display_name='tempest-TestMinimumBasicScenario-server-1820678847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1820678847',id=30,image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOcUNJ7stKb3KMtT8FxSOLLSev5GAWF4OsBnjWBDFeteLo8WKtCXD+UDLNpLVmo+wgU/JW1M0/sLMFfbSLkzBHfxPeTYrhTogzbuJVsaLeyXpOa5ZXWQL0lTt6/I1AT2A==',key_name='tempest-TestMinimumBasicScenario-1248998495',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:51:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcb84908fd7c41c29be354f4710f3296',ramdisk_id='',reservation_id='r-je062l15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='373173d6-6b3f-47e7-b7fb-7b1d4746676c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1615594861',owner_user_name='tempest-TestMinimumBasicScenario-1615594861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:54:32Z,user_data=None,user_id='17537606bbf046cd84a615eb779bab16',uuid=42555213-8dfd-4b93-8827-2b72ae3ca2e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converting VIF {"id": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "address": "fa:16:3e:19:82:5e", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5659f008-dd", "ovs_interfaceid": "5659f008-dda6-4153-b5fb-8cc33eba94ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG os_vif [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5659f008-dd, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9dad0726-0ea2-4b0d-adf1-6dddc9885534) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:57:32 user nova-compute[75993]: INFO os_vif [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:82:5e,bridge_name='br-int',has_traffic_filtering=True,id=5659f008-dda6-4153-b5fb-8cc33eba94ee,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5659f008-dd')
Nov 08 21:57:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Deleting instance files /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9_del
Nov 08 21:57:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Deletion of /opt/stack/data/nova/instances/42555213-8dfd-4b93-8827-2b72ae3ca2e9_del complete
Nov 08 21:57:32 user nova-compute[75993]: INFO nova.compute.manager [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 08 21:57:32 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 21:57:32 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 21:57:33 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:57:33 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Took 0.58 seconds to deallocate network for instance.
Nov 08 21:57:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-41165674-7196-4087-a25a-3317c49fa3c0 req-78b5acbe-0fe9-409f-80fe-0becab3c67cd service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-deleted-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:33 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:57:33 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:57:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.352s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:33 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Deleted allocations for instance 42555213-8dfd-4b93-8827-2b72ae3ca2e9
Nov 08 21:57:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f31fa5a4-095f-4a34-9a69-9da9e0f10cf7 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.196s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-24126295-7803-4ecc-8341-9930e5782436 req-84d7c41b-3e22-4855-8d78-1a7b4ce1df8c service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-24126295-7803-4ecc-8341-9930e5782436 req-84d7c41b-3e22-4855-8d78-1a7b4ce1df8c service nova] Acquiring lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-24126295-7803-4ecc-8341-9930e5782436 req-84d7c41b-3e22-4855-8d78-1a7b4ce1df8c service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-24126295-7803-4ecc-8341-9930e5782436 req-84d7c41b-3e22-4855-8d78-1a7b4ce1df8c service nova] Lock "42555213-8dfd-4b93-8827-2b72ae3ca2e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-24126295-7803-4ecc-8341-9930e5782436 req-84d7c41b-3e22-4855-8d78-1a7b4ce1df8c service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] No waiting events found dispatching network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:57:33 user nova-compute[75993]: WARNING nova.compute.manager [req-24126295-7803-4ecc-8341-9930e5782436 req-84d7c41b-3e22-4855-8d78-1a7b4ce1df8c service nova] [instance: 42555213-8dfd-4b93-8827-2b72ae3ca2e9] Received unexpected event network-vif-plugged-5659f008-dda6-4153-b5fb-8cc33eba94ee for instance with vm_state deleted and task_state None.
Nov 08 21:57:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-464e5e6a-9897-4672-9a99-0db998da74a7 req-596673dd-25cc-4ac7-afaa-453291ed48c6 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-changed-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-464e5e6a-9897-4672-9a99-0db998da74a7 req-596673dd-25cc-4ac7-afaa-453291ed48c6 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Refreshing instance network info cache due to event network-changed-f7dc5cf6-90f1-4ec4-9704-49322e9e2179. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:57:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-464e5e6a-9897-4672-9a99-0db998da74a7 req-596673dd-25cc-4ac7-afaa-453291ed48c6 service nova] Acquiring lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:57:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-464e5e6a-9897-4672-9a99-0db998da74a7 req-596673dd-25cc-4ac7-afaa-453291ed48c6 service nova] Acquired lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:57:41 user nova-compute[75993]: DEBUG nova.network.neutron [req-464e5e6a-9897-4672-9a99-0db998da74a7 req-596673dd-25cc-4ac7-afaa-453291ed48c6 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Refreshing network info cache for port f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:57:42 user nova-compute[75993]: DEBUG nova.network.neutron [req-464e5e6a-9897-4672-9a99-0db998da74a7 req-596673dd-25cc-4ac7-afaa-453291ed48c6 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updated VIF entry in instance network info cache for port f7dc5cf6-90f1-4ec4-9704-49322e9e2179. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:57:42 user nova-compute[75993]: DEBUG nova.network.neutron [req-464e5e6a-9897-4672-9a99-0db998da74a7 req-596673dd-25cc-4ac7-afaa-453291ed48c6 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updating instance_info_cache with network_info: [{"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:57:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-464e5e6a-9897-4672-9a99-0db998da74a7 req-596673dd-25cc-4ac7-afaa-453291ed48c6 service nova] Releasing lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:57:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Stashing vm_state: active {{(pid=75993) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 08 21:57:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:57:43 user nova-compute[75993]: INFO nova.compute.claims [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Claim successful on node user
Nov 08 21:57:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-f6768e6e-1414-42ee-bea2-22ab30d5c029 req-1136f5cf-3f94-4596-95fd-b2e5b18bfebf service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-changed-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-f6768e6e-1414-42ee-bea2-22ab30d5c029 req-1136f5cf-3f94-4596-95fd-b2e5b18bfebf service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Refreshing instance network info cache due to event network-changed-817baf15-2d4e-4d79-ab15-e70b6317cf5a. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:57:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f6768e6e-1414-42ee-bea2-22ab30d5c029 req-1136f5cf-3f94-4596-95fd-b2e5b18bfebf service nova] Acquiring lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:57:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f6768e6e-1414-42ee-bea2-22ab30d5c029 req-1136f5cf-3f94-4596-95fd-b2e5b18bfebf service nova] Acquired lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:57:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-f6768e6e-1414-42ee-bea2-22ab30d5c029 req-1136f5cf-3f94-4596-95fd-b2e5b18bfebf service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Refreshing network info cache for port 817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:57:43 user nova-compute[75993]: INFO nova.compute.resource_tracker [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating resource usage from migration 50371352-5231-4537-9a79-aaf579522acd
Nov 08 21:57:44 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:57:44 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:57:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.415s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:44 user nova-compute[75993]: INFO nova.compute.manager [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Migrating
Nov 08 21:57:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:57:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-f6768e6e-1414-42ee-bea2-22ab30d5c029 req-1136f5cf-3f94-4596-95fd-b2e5b18bfebf service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updated VIF entry in instance network info cache for port 817baf15-2d4e-4d79-ab15-e70b6317cf5a. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:57:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-f6768e6e-1414-42ee-bea2-22ab30d5c029 req-1136f5cf-3f94-4596-95fd-b2e5b18bfebf service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating instance_info_cache with network_info: [{"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:57:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f6768e6e-1414-42ee-bea2-22ab30d5c029 req-1136f5cf-3f94-4596-95fd-b2e5b18bfebf service nova] Releasing lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:57:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquired lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:57:44 user nova-compute[75993]: DEBUG nova.network.neutron [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:57:44 user nova-compute[75993]: DEBUG nova.network.neutron [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating instance_info_cache with network_info: [{"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:57:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Releasing lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:57:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Starting migrate_disk_and_power_off {{(pid=75993) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-541729d7-c035-4398-948c-9ee259c9f39f req-b9192eea-64d1-43d0-a238-a9e146e33eeb service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-vif-unplugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-541729d7-c035-4398-948c-9ee259c9f39f req-b9192eea-64d1-43d0-a238-a9e146e33eeb service nova] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-541729d7-c035-4398-948c-9ee259c9f39f req-b9192eea-64d1-43d0-a238-a9e146e33eeb service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-541729d7-c035-4398-948c-9ee259c9f39f req-b9192eea-64d1-43d0-a238-a9e146e33eeb service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-541729d7-c035-4398-948c-9ee259c9f39f req-b9192eea-64d1-43d0-a238-a9e146e33eeb service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] No waiting events found dispatching network-vif-unplugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:57:45 user nova-compute[75993]: WARNING nova.compute.manager [req-541729d7-c035-4398-948c-9ee259c9f39f req-b9192eea-64d1-43d0-a238-a9e146e33eeb service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received unexpected event network-vif-unplugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a for instance with vm_state active and task_state resize_migrating.
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:45 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Instance destroyed successfully.
Nov 08 21:57:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836352422',display_name='tempest-ServerActionsTestOtherA-server-1836352422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836352422',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIbQxx7DuVFUAXtivYRWFOk6i/ACW0OwEKdIgB2j1c2VjAAObwQ9qWcNKT6+OGS47GK/q93vubsJMppLLdAeY5qiAyBaCE0GMrdNogpncAZOwVmmfngYFO0ELy5AfYiWQ==',key_name='tempest-keypair-1988537750',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:56:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-ep0z5zdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:57:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=d5fe6095-7bc6-48ae-b858-5ea2148ee423,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-198302822-network", "vif_mac": "fa:16:3e:6c:a3:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-198302822-network", "vif_mac": "fa:16:3e:6c:a3:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG os_vif [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap817baf15-2d, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=492dc5fd-bfcf-4f28-8543-5d3f7c2cc302) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:46 user nova-compute[75993]: INFO os_vif [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d')
Nov 08 21:57:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTeEifgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:57:46 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[172f0a86-813a-4600-ab83-385668b8180d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:57:46 user nova-compute[75993]: No targets found.
Nov 08 21:57:46 user nova-compute[75993]: iSNS:
Nov 08 21:57:46 user nova-compute[75993]: No targets found.
Nov 08 21:57:46 user nova-compute[75993]: STATIC:
Nov 08 21:57:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76
Nov 08 21:57:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:57:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:57:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:57:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:57:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:57:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d
Nov 08 21:57:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:57:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:57:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4
Nov 08 21:57:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:57:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:57:46 user nova-compute[75993]: FIRMWARE:
Nov 08 21:57:46 user nova-compute[75993]: No targets found.
Nov 08 21:57:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:57:46 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:57:46 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[634447d6-40cd-47fa-8ee0-f381b7bb81d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eee7cc-e825-49f3-ae13-9919bb4a4559]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:57:46 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:57:46 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:57:46 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:57:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:57:46 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:57:46 user nova-compute[75993]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:57:46 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:57:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544d1c3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4'): ({'sde'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Removing single pathed devices sde {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ee9028-32ed-4499-9119-510005b8d755]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[08edae86-a9e6-4319-8066-49aa969bf9fd]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flushing IO for device /dev/sde {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5d3bdb-b5ba-4134-bcdb-43a005351cd5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1cc430-4745-4057-bdf3-d2585032fe14]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] SCSI volumes sde have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aede877-db0a-42b8-98b6-c4cccdb9ff9f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fedeb9-3520-460e-bdea-8c4b46685f28]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260]
Nov 08 21:57:46 user nova-compute[75993]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260] successful.
Nov 08 21:57:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[750802d0-8016-49b6-bc30-5fafe1a68f2e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== disconnect_volume: return (337ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:57:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-68f57909-d164-4f8b-a8b5-edb55d941b03 req-570c07cb-b513-4b5f-b0c7-60be8f54f0fa service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:57:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-68f57909-d164-4f8b-a8b5-edb55d941b03 req-570c07cb-b513-4b5f-b0c7-60be8f54f0fa service nova] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-68f57909-d164-4f8b-a8b5-edb55d941b03 req-570c07cb-b513-4b5f-b0c7-60be8f54f0fa service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-68f57909-d164-4f8b-a8b5-edb55d941b03 req-570c07cb-b513-4b5f-b0c7-60be8f54f0fa service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-68f57909-d164-4f8b-a8b5-edb55d941b03 req-570c07cb-b513-4b5f-b0c7-60be8f54f0fa service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] No waiting events found dispatching network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:57:47 user nova-compute[75993]: WARNING nova.compute.manager [req-68f57909-d164-4f8b-a8b5-edb55d941b03 req-570c07cb-b513-4b5f-b0c7-60be8f54f0fa service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received unexpected event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a for instance with vm_state active and task_state resize_migrating.
Nov 08 21:57:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Port 817baf15-2d4e-4d79-ab15-e70b6317cf5a binding to destination host user is already ACTIVE {{(pid=75993) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 08 21:57:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:57:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:57:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:57:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:57:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquired lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:57:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating instance_info_cache with network_info: [{"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Releasing lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG os_brick.utils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa916187-7826-4a93-93e3-31d7482b003a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e1efd5-57f7-404c-8eed-9f293010eb74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffeeef41-4ef1-4843-9058-39ab2122448b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d3b049-4d9c-4af6-a8c6-856fc1203bce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 21:57:48 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 21:57:48 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6de40e-c5f8-4aea-a49a-b5e59b6aeb86]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 21:57:48 user nova-compute[75993]: DEBUG os_brick.utils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:57:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:57:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:03 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:58:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:07 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:58:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:58:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:58:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-95f8efd2-7c61-49b3-9e7d-ec97a4d22615" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:58:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-95f8efd2-7c61-49b3-9e7d-ec97a4d22615" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:58:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Updating instance_info_cache with network_info: [{"id": "74dd16d2-b674-4372-a9a0-88b46af2c028", "address": "fa:16:3e:f2:19:50", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74dd16d2-b6", "ovs_interfaceid": "74dd16d2-b674-4372-a9a0-88b46af2c028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-95f8efd2-7c61-49b3-9e7d-ec97a4d22615" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:58:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/disk.rescue --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:58:11 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:58:11 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:58:11 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8123MB free_disk=24.896957397460938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:11 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Applying migration context for instance d5fe6095-7bc6-48ae-b858-5ea2148ee423 as it has an incoming, in-progress migration 50371352-5231-4537-9a79-aaf579522acd. Migration status is post-migrating {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 21:58:12 user nova-compute[75993]: INFO nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating resource usage from migration 50371352-5231-4537-9a79-aaf579522acd
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 3713db24-c1c7-4755-b94f-ec88b1fbc960 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Migration 50371352-5231-4537-9a79-aaf579522acd is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d5fe6095-7bc6-48ae-b858-5ea2148ee423 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:58:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Starting finish_migration {{(pid=75993) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Instance directory exists: not creating {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 08 21:58:13 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Creating image(s)
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Ensure instance console log exists: /opt/stack/data/nova/instances/d5fe6095-7bc6-48ae-b858-5ea2148ee423/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Start _get_guest_xml network_info=[{"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-198302822-network", "vif_mac": "fa:16:3e:6c:a3:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'ccd3f807-f358-47fd-a5a6-ff988448c645', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTeEifgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd5fe6095-7bc6-48ae-b858-5ea2148ee423', 'attached_at': '2023-11-08T21:58:14.000000', 'detached_at': '', 'volume_id': 'd066025e-5c4a-478d-b7c8-4b70449486e4', 'serial': 'd066025e-5c4a-478d-b7c8-4b70449486e4'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:58:13 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:58:13 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:02Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTeEifgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:58:13 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:58:13 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:58:13 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d986cd8-58af-4c38-b9b1-e03caa3976aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 21:58:13 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4745dd-4c03-45c9-b96e-c290bd9513b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4] added
Nov 08 21:58:13 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ca4c28-a7be-4f4f-ad37-e99ee65c3e64]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[11346282-3799-4d53-bd0f-6a9ad2876dc3]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTeEifgZ {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTeEifgZ" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3865946b-d642-4db6-80f8-1704fd573c98]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTeEifgZ'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47e97e2-927e-42b5-b704-f8fff1b8fe46]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[35035034-a031-4cb3-9d06-9e223a0b96d9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:58:13 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:58:13 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:58:13 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:58:13 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:58:13 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:58:13 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:58:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6370ad0-91fb-4677-a856-d8535f399c97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260]
Nov 08 21:58:14 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260] successful.
Nov 08 21:58:14 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc7fe25-0a78-49a9-bef8-e2bd1a8a13a7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0a6558-9bda-497e-a78f-e77ba52b0d0d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:58:14 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:58:14 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:58:14 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:58:14 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:58:14 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:58:14 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:58:14 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:58:14 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b8d755-7507-4564-9424-4b856b50b7ce]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 21:58:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTeEifgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23236623162623364', 'path': '/dev/sde'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236623162623364', 'path': '/dev/sde'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836352422',display_name='tempest-ServerActionsTestOtherA-server-1836352422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836352422',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIbQxx7DuVFUAXtivYRWFOk6i/ACW0OwEKdIgB2j1c2VjAAObwQ9qWcNKT6+OGS47GK/q93vubsJMppLLdAeY5qiAyBaCE0GMrdNogpncAZOwVmmfngYFO0ELy5AfYiWQ==',key_name='tempest-keypair-1988537750',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:56:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-ep0z5zdk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:57:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=d5fe6095-7bc6-48ae-b858-5ea2148ee423,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-198302822-network", "vif_mac": "fa:16:3e:6c:a3:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-198302822-network", "vif_mac": "fa:16:3e:6c:a3:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:58:15 user nova-compute[75993]:   <uuid>d5fe6095-7bc6-48ae-b858-5ea2148ee423</uuid>
Nov 08 21:58:15 user nova-compute[75993]:   <name>instance-00000021</name>
Nov 08 21:58:15 user nova-compute[75993]:   <memory>2097152</memory>
Nov 08 21:58:15 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:58:15 user nova-compute[75993]:   <metadata>
Nov 08 21:58:15 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:58:15 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:58:15 user nova-compute[75993]:       <nova:name>tempest-ServerActionsTestOtherA-server-1836352422</nova:name>
Nov 08 21:58:15 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:58:13</nova:creationTime>
Nov 08 21:58:15 user nova-compute[75993]:       <nova:flavor name="m1.small">
Nov 08 21:58:15 user nova-compute[75993]:         <nova:memory>2048</nova:memory>
Nov 08 21:58:15 user nova-compute[75993]:         <nova:disk>20</nova:disk>
Nov 08 21:58:15 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:58:15 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:58:15 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:58:15 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:58:15 user nova-compute[75993]:       <nova:owner>
Nov 08 21:58:15 user nova-compute[75993]:         <nova:user uuid="24c7a7bdeeda41339b11c9e9e1ad4c8d">tempest-ServerActionsTestOtherA-1530278199-project-member</nova:user>
Nov 08 21:58:15 user nova-compute[75993]:         <nova:project uuid="696fc6c404c244ccba1a90b11e5437de">tempest-ServerActionsTestOtherA-1530278199</nova:project>
Nov 08 21:58:15 user nova-compute[75993]:       </nova:owner>
Nov 08 21:58:15 user nova-compute[75993]:       <nova:ports>
Nov 08 21:58:15 user nova-compute[75993]:         <nova:port uuid="817baf15-2d4e-4d79-ab15-e70b6317cf5a">
Nov 08 21:58:15 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 21:58:15 user nova-compute[75993]:         </nova:port>
Nov 08 21:58:15 user nova-compute[75993]:       </nova:ports>
Nov 08 21:58:15 user nova-compute[75993]:     </nova:instance>
Nov 08 21:58:15 user nova-compute[75993]:   </metadata>
Nov 08 21:58:15 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:58:15 user nova-compute[75993]:     <system>
Nov 08 21:58:15 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:58:15 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:58:15 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:58:15 user nova-compute[75993]:       <entry name="serial">d5fe6095-7bc6-48ae-b858-5ea2148ee423</entry>
Nov 08 21:58:15 user nova-compute[75993]:       <entry name="uuid">d5fe6095-7bc6-48ae-b858-5ea2148ee423</entry>
Nov 08 21:58:15 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:58:15 user nova-compute[75993]:     </system>
Nov 08 21:58:15 user nova-compute[75993]:   </sysinfo>
Nov 08 21:58:15 user nova-compute[75993]:   <os>
Nov 08 21:58:15 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:58:15 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:58:15 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:58:15 user nova-compute[75993]:   </os>
Nov 08 21:58:15 user nova-compute[75993]:   <features>
Nov 08 21:58:15 user nova-compute[75993]:     <acpi/>
Nov 08 21:58:15 user nova-compute[75993]:     <apic/>
Nov 08 21:58:15 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:58:15 user nova-compute[75993]:   </features>
Nov 08 21:58:15 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:58:15 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:58:15 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:58:15 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:58:15 user nova-compute[75993]:   </clock>
Nov 08 21:58:15 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:58:15 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:58:15 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:58:15 user nova-compute[75993]:   </cpu>
Nov 08 21:58:15 user nova-compute[75993]:   <devices>
Nov 08 21:58:15 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 21:58:15 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 21:58:15 user nova-compute[75993]:       <source dev="/dev/sde"/>
Nov 08 21:58:15 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:58:15 user nova-compute[75993]:       <serial>d066025e-5c4a-478d-b7c8-4b70449486e4</serial>
Nov 08 21:58:15 user nova-compute[75993]:     </disk>
Nov 08 21:58:15 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:58:15 user nova-compute[75993]:       <mac address="fa:16:3e:6c:a3:fa"/>
Nov 08 21:58:15 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:58:15 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:58:15 user nova-compute[75993]:       <target dev="tap817baf15-2d"/>
Nov 08 21:58:15 user nova-compute[75993]:     </interface>
Nov 08 21:58:15 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:58:15 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/d5fe6095-7bc6-48ae-b858-5ea2148ee423/console.log" append="off"/>
Nov 08 21:58:15 user nova-compute[75993]:     </serial>
Nov 08 21:58:15 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:58:15 user nova-compute[75993]:     <video>
Nov 08 21:58:15 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:58:15 user nova-compute[75993]:     </video>
Nov 08 21:58:15 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:58:15 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:58:15 user nova-compute[75993]:     </rng>
Nov 08 21:58:15 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:58:15 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:58:15 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:58:15 user nova-compute[75993]:     </memballoon>
Nov 08 21:58:15 user nova-compute[75993]:   </devices>
Nov 08 21:58:15 user nova-compute[75993]: </domain>
Nov 08 21:58:15 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836352422',display_name='tempest-ServerActionsTestOtherA-server-1836352422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836352422',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIbQxx7DuVFUAXtivYRWFOk6i/ACW0OwEKdIgB2j1c2VjAAObwQ9qWcNKT6+OGS47GK/q93vubsJMppLLdAeY5qiAyBaCE0GMrdNogpncAZOwVmmfngYFO0ELy5AfYiWQ==',key_name='tempest-keypair-1988537750',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:56:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-ep0z5zdk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:57:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=d5fe6095-7bc6-48ae-b858-5ea2148ee423,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-198302822-network", "vif_mac": "fa:16:3e:6c:a3:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-198302822-network", "vif_mac": "fa:16:3e:6c:a3:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG os_vif [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '741c652a-2766-5159-8444-73ad8038a04d', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap817baf15-2d, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap817baf15-2d, col_values=(('qos', UUID('7ef04c3c-5ab8-417a-8590-239f33be48a8')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap817baf15-2d, col_values=(('external_ids', {'iface-id': '817baf15-2d4e-4d79-ab15-e70b6317cf5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:a3:fa', 'vm-uuid': 'd5fe6095-7bc6-48ae-b858-5ea2148ee423'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:15 user nova-compute[75993]: INFO os_vif [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d')
Nov 08 21:58:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] No VIF found with MAC fa:16:3e:6c:a3:fa, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:58:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:58:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-137513a8-1069-4f78-b103-76522354e478 req-7c5ee779-d9b5-47b3-b71a-9bdbfaf579d8 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:58:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-137513a8-1069-4f78-b103-76522354e478 req-7c5ee779-d9b5-47b3-b71a-9bdbfaf579d8 service nova] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-137513a8-1069-4f78-b103-76522354e478 req-7c5ee779-d9b5-47b3-b71a-9bdbfaf579d8 service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-137513a8-1069-4f78-b103-76522354e478 req-7c5ee779-d9b5-47b3-b71a-9bdbfaf579d8 service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-137513a8-1069-4f78-b103-76522354e478 req-7c5ee779-d9b5-47b3-b71a-9bdbfaf579d8 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] No waiting events found dispatching network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:58:16 user nova-compute[75993]: WARNING nova.compute.manager [req-137513a8-1069-4f78-b103-76522354e478 req-7c5ee779-d9b5-47b3-b71a-9bdbfaf579d8 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received unexpected event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a for instance with vm_state active and task_state resize_finish.
Nov 08 21:58:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:58:18 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Instance running successfully.
Nov 08 21:58:18 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Failed to set time: agent not configured {{(pid=75993) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 08 21:58:18 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-4922ac22-b493-4641-8a6d-58b2b6c362fe tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] finish_migration finished successfully. {{(pid=75993) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 08 21:58:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-0581f381-396b-4ee9-9664-f032f4cac06f req-f8d3ac5b-1757-41d2-a0ba-be3679e3eb8f service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:58:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0581f381-396b-4ee9-9664-f032f4cac06f req-f8d3ac5b-1757-41d2-a0ba-be3679e3eb8f service nova] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0581f381-396b-4ee9-9664-f032f4cac06f req-f8d3ac5b-1757-41d2-a0ba-be3679e3eb8f service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0581f381-396b-4ee9-9664-f032f4cac06f req-f8d3ac5b-1757-41d2-a0ba-be3679e3eb8f service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-0581f381-396b-4ee9-9664-f032f4cac06f req-f8d3ac5b-1757-41d2-a0ba-be3679e3eb8f service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] No waiting events found dispatching network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:58:18 user nova-compute[75993]: WARNING nova.compute.manager [req-0581f381-396b-4ee9-9664-f032f4cac06f req-f8d3ac5b-1757-41d2-a0ba-be3679e3eb8f service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received unexpected event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a for instance with vm_state active and task_state resize_finish.
Nov 08 21:58:19 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:58:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:58:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:58:26 user nova-compute[75993]: INFO nova.compute.claims [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Claim successful on node user
Nov 08 21:58:26 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:58:26 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG nova.network.neutron [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:58:27 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:58:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG nova.policy [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17537606bbf046cd84a615eb779bab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dcb84908fd7c41c29be354f4710f3296', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:58:27 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Creating image(s)
Nov 08 21:58:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "/opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "/opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "ea2fe87a11a6748e62bc8054f834b4a4083face6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "ea2fe87a11a6748e62bc8054f834b4a4083face6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6.part --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6.part --force-share --output=json" returned: 0 in 0.211s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG nova.virt.images [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] 868f02a6-975b-4c46-9946-7b665df308ca was qcow2, converting to raw {{(pid=75993) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6.part /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6.converted {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6.part /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6.converted" returned: 0 in 0.373s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6.converted --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "ea2fe87a11a6748e62bc8054f834b4a4083face6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.351s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG nova.network.neutron [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Successfully created port: 95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6 --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "ea2fe87a11a6748e62bc8054f834b4a4083face6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "ea2fe87a11a6748e62bc8054f834b4a4083face6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6 --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:28 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6,backing_fmt=raw /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6,backing_fmt=raw /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk 1073741824" returned: 0 in 0.055s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "ea2fe87a11a6748e62bc8054f834b4a4083face6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6 --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Cannot resize image /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Ensure instance console log exists: /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.network.neutron [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Successfully updated port: 95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquired lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.network.neutron [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-9933d678-9cb3-4fa4-bacb-f3f91d5b28bd req-3f420cc9-dea1-4da4-967c-4a4359303505 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-changed-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-9933d678-9cb3-4fa4-bacb-f3f91d5b28bd req-3f420cc9-dea1-4da4-967c-4a4359303505 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Refreshing instance network info cache due to event network-changed-95040a92-cb5d-43b2-9a5a-c54f134f28f6. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9933d678-9cb3-4fa4-bacb-f3f91d5b28bd req-3f420cc9-dea1-4da4-967c-4a4359303505 service nova] Acquiring lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.network.neutron [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.network.neutron [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updating instance_info_cache with network_info: [{"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Releasing lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.compute.manager [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Instance network_info: |[{"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9933d678-9cb3-4fa4-bacb-f3f91d5b28bd req-3f420cc9-dea1-4da4-967c-4a4359303505 service nova] Acquired lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.network.neutron [req-9933d678-9cb3-4fa4-bacb-f3f91d5b28bd req-3f420cc9-dea1-4da4-967c-4a4359303505 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Refreshing network info cache for port 95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Start _get_guest_xml network_info=[{"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:58:23Z,direct_url=<?>,disk_format='qcow2',id=868f02a6-975b-4c46-9946-7b665df308ca,min_disk=0,min_ram=0,name='tempest-scenario-img--597822330',owner='dcb84908fd7c41c29be354f4710f3296',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:58:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '868f02a6-975b-4c46-9946-7b665df308ca'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:58:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:58:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:58:23Z,direct_url=<?>,disk_format='qcow2',id=868f02a6-975b-4c46-9946-7b665df308ca,min_disk=0,min_ram=0,name='tempest-scenario-img--597822330',owner='dcb84908fd7c41c29be354f4710f3296',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:58:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2053641649',display_name='tempest-TestMinimumBasicScenario-server-2053641649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2053641649',id=35,image_ref='868f02a6-975b-4c46-9946-7b665df308ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5JIaYYS6mJygvwfP+ooR3+z/eHWshdF32wmW9uMBngeQ8pLGawJ1cHryaOBMk0cTXqvy19MlXg2DnStIoQvTwGCRIMxBl1xhSjafzuDdJ5Tcx3oLJFX9LZQaKoPZJugg==',key_name='tempest-TestMinimumBasicScenario-164345626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcb84908fd7c41c29be354f4710f3296',ramdisk_id='',reservation_id='r-seuukvgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='868f02a6-975b-4c46-9946-7b665df308ca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1615594861',owner_user_name='tempest-TestMinimumBasicScenario-1615594861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:58:27Z,user_data=None,user_id='17537606bbf046cd84a615eb779bab16',uuid=4cf75975-1760-4697-8186-87ccee8ae77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converting VIF {"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f7:31,bridge_name='br-int',has_traffic_filtering=True,id=95040a92-cb5d-43b2-9a5a-c54f134f28f6,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95040a92-cb') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.objects.instance [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cf75975-1760-4697-8186-87ccee8ae77b {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:58:30 user nova-compute[75993]:   <uuid>4cf75975-1760-4697-8186-87ccee8ae77b</uuid>
Nov 08 21:58:30 user nova-compute[75993]:   <name>instance-00000023</name>
Nov 08 21:58:30 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:58:30 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:58:30 user nova-compute[75993]:   <metadata>
Nov 08 21:58:30 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:58:30 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:58:30 user nova-compute[75993]:       <nova:name>tempest-TestMinimumBasicScenario-server-2053641649</nova:name>
Nov 08 21:58:30 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:58:30</nova:creationTime>
Nov 08 21:58:30 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:58:30 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:58:30 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:58:30 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:58:30 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:58:30 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:58:30 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:58:30 user nova-compute[75993]:       <nova:owner>
Nov 08 21:58:30 user nova-compute[75993]:         <nova:user uuid="17537606bbf046cd84a615eb779bab16">tempest-TestMinimumBasicScenario-1615594861-project-member</nova:user>
Nov 08 21:58:30 user nova-compute[75993]:         <nova:project uuid="dcb84908fd7c41c29be354f4710f3296">tempest-TestMinimumBasicScenario-1615594861</nova:project>
Nov 08 21:58:30 user nova-compute[75993]:       </nova:owner>
Nov 08 21:58:30 user nova-compute[75993]:       <nova:root type="image" uuid="868f02a6-975b-4c46-9946-7b665df308ca"/>
Nov 08 21:58:30 user nova-compute[75993]:       <nova:ports>
Nov 08 21:58:30 user nova-compute[75993]:         <nova:port uuid="95040a92-cb5d-43b2-9a5a-c54f134f28f6">
Nov 08 21:58:30 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 08 21:58:30 user nova-compute[75993]:         </nova:port>
Nov 08 21:58:30 user nova-compute[75993]:       </nova:ports>
Nov 08 21:58:30 user nova-compute[75993]:     </nova:instance>
Nov 08 21:58:30 user nova-compute[75993]:   </metadata>
Nov 08 21:58:30 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:58:30 user nova-compute[75993]:     <system>
Nov 08 21:58:30 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:58:30 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:58:30 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:58:30 user nova-compute[75993]:       <entry name="serial">4cf75975-1760-4697-8186-87ccee8ae77b</entry>
Nov 08 21:58:30 user nova-compute[75993]:       <entry name="uuid">4cf75975-1760-4697-8186-87ccee8ae77b</entry>
Nov 08 21:58:30 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:58:30 user nova-compute[75993]:     </system>
Nov 08 21:58:30 user nova-compute[75993]:   </sysinfo>
Nov 08 21:58:30 user nova-compute[75993]:   <os>
Nov 08 21:58:30 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:58:30 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:58:30 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:58:30 user nova-compute[75993]:   </os>
Nov 08 21:58:30 user nova-compute[75993]:   <features>
Nov 08 21:58:30 user nova-compute[75993]:     <acpi/>
Nov 08 21:58:30 user nova-compute[75993]:     <apic/>
Nov 08 21:58:30 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:58:30 user nova-compute[75993]:   </features>
Nov 08 21:58:30 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:58:30 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:58:30 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:58:30 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:58:30 user nova-compute[75993]:   </clock>
Nov 08 21:58:30 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:58:30 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:58:30 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:58:30 user nova-compute[75993]:   </cpu>
Nov 08 21:58:30 user nova-compute[75993]:   <devices>
Nov 08 21:58:30 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:58:30 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:58:30 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk"/>
Nov 08 21:58:30 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:58:30 user nova-compute[75993]:     </disk>
Nov 08 21:58:30 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:58:30 user nova-compute[75993]:       <mac address="fa:16:3e:2e:f7:31"/>
Nov 08 21:58:30 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:58:30 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:58:30 user nova-compute[75993]:       <target dev="tap95040a92-cb"/>
Nov 08 21:58:30 user nova-compute[75993]:     </interface>
Nov 08 21:58:30 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:58:30 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/console.log" append="off"/>
Nov 08 21:58:30 user nova-compute[75993]:     </serial>
Nov 08 21:58:30 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:58:30 user nova-compute[75993]:     <video>
Nov 08 21:58:30 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:58:30 user nova-compute[75993]:     </video>
Nov 08 21:58:30 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:58:30 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:58:30 user nova-compute[75993]:     </rng>
Nov 08 21:58:30 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:58:30 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:58:30 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:58:30 user nova-compute[75993]:     </memballoon>
Nov 08 21:58:30 user nova-compute[75993]:   </devices>
Nov 08 21:58:30 user nova-compute[75993]: </domain>
Nov 08 21:58:30 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2053641649',display_name='tempest-TestMinimumBasicScenario-server-2053641649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2053641649',id=35,image_ref='868f02a6-975b-4c46-9946-7b665df308ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5JIaYYS6mJygvwfP+ooR3+z/eHWshdF32wmW9uMBngeQ8pLGawJ1cHryaOBMk0cTXqvy19MlXg2DnStIoQvTwGCRIMxBl1xhSjafzuDdJ5Tcx3oLJFX9LZQaKoPZJugg==',key_name='tempest-TestMinimumBasicScenario-164345626',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dcb84908fd7c41c29be354f4710f3296',ramdisk_id='',reservation_id='r-seuukvgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='868f02a6-975b-4c46-9946-7b665df308ca',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1615594861',owner_user_name='tempest-TestMinimumBasicScenario-1615594861-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:58:27Z,user_data=None,user_id='17537606bbf046cd84a615eb779bab16',uuid=4cf75975-1760-4697-8186-87ccee8ae77b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converting VIF {"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f7:31,bridge_name='br-int',has_traffic_filtering=True,id=95040a92-cb5d-43b2-9a5a-c54f134f28f6,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95040a92-cb') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG os_vif [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f7:31,bridge_name='br-int',has_traffic_filtering=True,id=95040a92-cb5d-43b2-9a5a-c54f134f28f6,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95040a92-cb') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '601bb94a-1c23-54e1-87ba-1f14195042e9', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95040a92-cb, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95040a92-cb, col_values=(('qos', UUID('f004ec74-a639-421d-895f-11089accbd4f')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95040a92-cb, col_values=(('external_ids', {'iface-id': '95040a92-cb5d-43b2-9a5a-c54f134f28f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:f7:31', 'vm-uuid': '4cf75975-1760-4697-8186-87ccee8ae77b'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:30 user nova-compute[75993]: INFO os_vif [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:f7:31,bridge_name='br-int',has_traffic_filtering=True,id=95040a92-cb5d-43b2-9a5a-c54f134f28f6,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95040a92-cb')
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:58:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] No VIF found with MAC fa:16:3e:2e:f7:31, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:58:31 user nova-compute[75993]: DEBUG nova.network.neutron [req-9933d678-9cb3-4fa4-bacb-f3f91d5b28bd req-3f420cc9-dea1-4da4-967c-4a4359303505 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updated VIF entry in instance network info cache for port 95040a92-cb5d-43b2-9a5a-c54f134f28f6. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:58:31 user nova-compute[75993]: DEBUG nova.network.neutron [req-9933d678-9cb3-4fa4-bacb-f3f91d5b28bd req-3f420cc9-dea1-4da4-967c-4a4359303505 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updating instance_info_cache with network_info: [{"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:58:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9933d678-9cb3-4fa4-bacb-f3f91d5b28bd req-3f420cc9-dea1-4da4-967c-4a4359303505 service nova] Releasing lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:58:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-40179ae4-dbec-447b-8b7e-44bb1c5abfc7 req-29b2aca3-5ced-4ee4-babc-a2d2306dc8a3 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:58:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-40179ae4-dbec-447b-8b7e-44bb1c5abfc7 req-29b2aca3-5ced-4ee4-babc-a2d2306dc8a3 service nova] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-40179ae4-dbec-447b-8b7e-44bb1c5abfc7 req-29b2aca3-5ced-4ee4-babc-a2d2306dc8a3 service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-40179ae4-dbec-447b-8b7e-44bb1c5abfc7 req-29b2aca3-5ced-4ee4-babc-a2d2306dc8a3 service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-40179ae4-dbec-447b-8b7e-44bb1c5abfc7 req-29b2aca3-5ced-4ee4-babc-a2d2306dc8a3 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] No waiting events found dispatching network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:58:32 user nova-compute[75993]: WARNING nova.compute.manager [req-40179ae4-dbec-447b-8b7e-44bb1c5abfc7 req-29b2aca3-5ced-4ee4-babc-a2d2306dc8a3 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received unexpected event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 for instance with vm_state building and task_state spawning.
Nov 08 21:58:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:58:34 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Instance spawned successfully.
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-80e3d6a9-da53-4ef0-9f9b-44123a0aa8bd req-2b09b5d4-fc96-446d-bc9d-92109fd9d86f service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-80e3d6a9-da53-4ef0-9f9b-44123a0aa8bd req-2b09b5d4-fc96-446d-bc9d-92109fd9d86f service nova] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-80e3d6a9-da53-4ef0-9f9b-44123a0aa8bd req-2b09b5d4-fc96-446d-bc9d-92109fd9d86f service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-80e3d6a9-da53-4ef0-9f9b-44123a0aa8bd req-2b09b5d4-fc96-446d-bc9d-92109fd9d86f service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-80e3d6a9-da53-4ef0-9f9b-44123a0aa8bd req-2b09b5d4-fc96-446d-bc9d-92109fd9d86f service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] No waiting events found dispatching network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:58:34 user nova-compute[75993]: WARNING nova.compute.manager [req-80e3d6a9-da53-4ef0-9f9b-44123a0aa8bd req-2b09b5d4-fc96-446d-bc9d-92109fd9d86f service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received unexpected event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 for instance with vm_state building and task_state spawning.
Nov 08 21:58:34 user nova-compute[75993]: INFO nova.compute.manager [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Took 7.40 seconds to spawn the instance on the hypervisor.
Nov 08 21:58:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:58:34 user nova-compute[75993]: INFO nova.compute.manager [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Took 8.32 seconds to build instance.
Nov 08 21:58:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-050db38f-2166-4f1d-8164-5456cf024a6d tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.434s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-78dff35f-c85b-4a3c-9cd9-a44ccecf3ffd req-48662552-a846-4bf3-a968-45c128a44fe4 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-changed-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:58:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-78dff35f-c85b-4a3c-9cd9-a44ccecf3ffd req-48662552-a846-4bf3-a968-45c128a44fe4 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Refreshing instance network info cache due to event network-changed-fe2d45f6-7eff-41c3-b47d-7f499f73bf33. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:58:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78dff35f-c85b-4a3c-9cd9-a44ccecf3ffd req-48662552-a846-4bf3-a968-45c128a44fe4 service nova] Acquiring lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:58:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78dff35f-c85b-4a3c-9cd9-a44ccecf3ffd req-48662552-a846-4bf3-a968-45c128a44fe4 service nova] Acquired lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:58:40 user nova-compute[75993]: DEBUG nova.network.neutron [req-78dff35f-c85b-4a3c-9cd9-a44ccecf3ffd req-48662552-a846-4bf3-a968-45c128a44fe4 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Refreshing network info cache for port fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:58:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:41 user nova-compute[75993]: DEBUG nova.network.neutron [req-78dff35f-c85b-4a3c-9cd9-a44ccecf3ffd req-48662552-a846-4bf3-a968-45c128a44fe4 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updated VIF entry in instance network info cache for port fe2d45f6-7eff-41c3-b47d-7f499f73bf33. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:58:41 user nova-compute[75993]: DEBUG nova.network.neutron [req-78dff35f-c85b-4a3c-9cd9-a44ccecf3ffd req-48662552-a846-4bf3-a968-45c128a44fe4 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating instance_info_cache with network_info: [{"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:58:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:41 user nova-compute[75993]: INFO nova.compute.manager [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Shelve offloading
Nov 08 21:58:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78dff35f-c85b-4a3c-9cd9-a44ccecf3ffd req-48662552-a846-4bf3-a968-45c128a44fe4 service nova] Releasing lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:58:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:42 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Instance destroyed successfully.
Nov 08 21:58:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:58:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:58:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquired lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:58:42 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:58:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating instance_info_cache with network_info: [{"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:58:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Releasing lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:58:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-63a47815-584d-4a11-99e9-e564d7a0775d req-65f103e5-5a29-449e-aee1-264f6a72e447 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-vif-unplugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-63a47815-584d-4a11-99e9-e564d7a0775d req-65f103e5-5a29-449e-aee1-264f6a72e447 service nova] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-63a47815-584d-4a11-99e9-e564d7a0775d req-65f103e5-5a29-449e-aee1-264f6a72e447 service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-63a47815-584d-4a11-99e9-e564d7a0775d req-65f103e5-5a29-449e-aee1-264f6a72e447 service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-63a47815-584d-4a11-99e9-e564d7a0775d req-65f103e5-5a29-449e-aee1-264f6a72e447 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] No waiting events found dispatching network-vif-unplugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:58:44 user nova-compute[75993]: WARNING nova.compute.manager [req-63a47815-584d-4a11-99e9-e564d7a0775d req-65f103e5-5a29-449e-aee1-264f6a72e447 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received unexpected event network-vif-unplugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 for instance with vm_state active and task_state shelving.
Nov 08 21:58:44 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Instance destroyed successfully.
Nov 08 21:58:44 user nova-compute[75993]: DEBUG nova.objects.instance [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lazy-loading 'resources' on Instance uuid 3713db24-c1c7-4755-b94f-ec88b1fbc960 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1289890038',display_name='tempest-TestShelveInstance-server-1289890038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1289890038',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYpfKFamOS8ZmffOZUH83SooiZofpo/zMgwflGnwGStjsdQwy4OitgGLlVKVUnTQ7qUq17P715+FUnTYTZWPElqsI7SoOWfJ4AQYQyb7Tt1NxCTzAFKHzDPudlIcSfDzw==',key_name='tempest-TestShelveInstance-243862016',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:57:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='482c9b5155b94bb1a5f1189ffc0c9cdc',ramdisk_id='',reservation_id='r-p0nylb07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-510215546',owner_user_name='tempest-TestShelveInstance-510215546-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:57:23Z,user_data=None,user_id='55e7e193334f4d83949bf4119b71661c',uuid=3713db24-c1c7-4755-b94f-ec88b1fbc960,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converting VIF {"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_vif [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe2d45f6-7e, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c113802d-ab41-4e65-a2a4-36b09ddf67e4) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:44 user nova-compute[75993]: INFO os_vif [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e')
Nov 08 21:58:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXNAgQDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 21:58:44 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c9e074-ff19-4c03-9a52-0e880327a163]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:097849c3-7c8f-4751-bcd4-6f3344c5e28e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 21:58:44 user nova-compute[75993]: No targets found.
Nov 08 21:58:44 user nova-compute[75993]: iSNS:
Nov 08 21:58:44 user nova-compute[75993]: No targets found.
Nov 08 21:58:44 user nova-compute[75993]: STATIC:
Nov 08 21:58:44 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76
Nov 08 21:58:44 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:58:44 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:58:44 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 21:58:44 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:58:44 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:58:44 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d
Nov 08 21:58:44 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:58:44 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:58:44 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:097849c3-7c8f-4751-bcd4-6f3344c5e28e
Nov 08 21:58:44 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:58:44 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:58:44 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4
Nov 08 21:58:44 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 21:58:44 user nova-compute[75993]:                 Iface Name: default
Nov 08 21:58:44 user nova-compute[75993]: FIRMWARE:
Nov 08 21:58:44 user nova-compute[75993]: No targets found.
Nov 08 21:58:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 21:58:44 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 21:58:44 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78ae306-faac-4a60-b07c-938c3d936150]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:097849c3-7c8f-4751-bcd4-6f3344c5e28e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cc2a53-517c-4fcb-a2c7-469faa646101]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097849c3-7c8f-4751-bcd4-6f3344c5e28e (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:58:44 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:58:44 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:58:44 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:58:44 user nova-compute[75993]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097849c3-7c8f-4751-bcd4-6f3344c5e28e (non-flash)
Nov 08 21:58:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 21:58:44 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 21:58:44 user nova-compute[75993]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 21:58:44 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 21:58:44 user nova-compute[75993]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:097849c3-7c8f-4751-bcd4-6f3344c5e28e (non-flash)
Nov 08 21:58:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f856850eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[809570ae-90d6-402e-9aab-09aa78587b82]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a8c5bd-b3f4-4780-8425-cafce0137c4a]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d4638a-6234-4773-8a75-17001d372496]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0f6bcd-9992-44d6-99bb-ad7191b1d798]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4854158e-fd0d-4f5e-aeca-fe953045aa3e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8780c2d2-f584-4036-b8fa-7f7db7d94f8a]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260]
Nov 08 21:58:44 user nova-compute[75993]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260] successful.
Nov 08 21:58:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[758986c4-01a8-4f5a-bac8-71c61c095631]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] <== disconnect_volume: return (353ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 21:58:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 21:58:44 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Deleting instance files /opt/stack/data/nova/instances/3713db24-c1c7-4755-b94f-ec88b1fbc960_del
Nov 08 21:58:44 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Deletion of /opt/stack/data/nova/instances/3713db24-c1c7-4755-b94f-ec88b1fbc960_del complete
Nov 08 21:58:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-5abdf18a-453b-4b4c-9419-c990776065a3 req-129e4037-921e-4c72-a85b-6194f64e528e service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-changed-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-5abdf18a-453b-4b4c-9419-c990776065a3 req-129e4037-921e-4c72-a85b-6194f64e528e service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Refreshing instance network info cache due to event network-changed-fe2d45f6-7eff-41c3-b47d-7f499f73bf33. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5abdf18a-453b-4b4c-9419-c990776065a3 req-129e4037-921e-4c72-a85b-6194f64e528e service nova] Acquiring lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5abdf18a-453b-4b4c-9419-c990776065a3 req-129e4037-921e-4c72-a85b-6194f64e528e service nova] Acquired lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG nova.network.neutron [req-5abdf18a-453b-4b4c-9419-c990776065a3 req-129e4037-921e-4c72-a85b-6194f64e528e service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Refreshing network info cache for port fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:58:46 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Deleted allocations for instance 3713db24-c1c7-4755-b94f-ec88b1fbc960
Nov 08 21:58:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lazy-loading 'numa_topology' on Instance uuid 3713db24-c1c7-4755-b94f-ec88b1fbc960 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG nova.objects.base [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Object Instance<3713db24-c1c7-4755-b94f-ec88b1fbc960> lazy-loaded attributes: resources,numa_topology {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG nova.network.neutron [req-5abdf18a-453b-4b4c-9419-c990776065a3 req-129e4037-921e-4c72-a85b-6194f64e528e service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updated VIF entry in instance network info cache for port fe2d45f6-7eff-41c3-b47d-7f499f73bf33. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG nova.network.neutron [req-5abdf18a-453b-4b4c-9419-c990776065a3 req-129e4037-921e-4c72-a85b-6194f64e528e service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating instance_info_cache with network_info: [{"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": null, "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5abdf18a-453b-4b4c-9419-c990776065a3 req-129e4037-921e-4c72-a85b-6194f64e528e service nova] Releasing lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:58:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c41d4edf-1090-486d-abb4-a0984a67863e tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.354s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:58:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:54 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:58:54 user nova-compute[75993]: INFO nova.compute.claims [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Claim successful on node user
Nov 08 21:58:54 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG nova.network.neutron [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:58:55 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:58:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG nova.policy [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9d3162aaa4874fd98c3bd8a1732a5f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e63286e9009742619d06722d00a6d99a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:58:55 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Creating image(s)
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "/opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "/opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.211s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.263s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk 1073741824" returned: 0 in 0.053s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG nova.network.neutron [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Successfully created port: 5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.266s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Cannot resize image /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Ensure instance console log exists: /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG nova.network.neutron [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Successfully updated port: 5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquired lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG nova.network.neutron [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-2a12c1b3-ce90-418b-a6cd-a67c0217723f req-0ce642e2-f81a-4fdc-9f8b-1dc6c27737ad service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Received event network-changed-5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-2a12c1b3-ce90-418b-a6cd-a67c0217723f req-0ce642e2-f81a-4fdc-9f8b-1dc6c27737ad service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Refreshing instance network info cache due to event network-changed-5ab96f99-3763-404e-aceb-1b793e648422. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2a12c1b3-ce90-418b-a6cd-a67c0217723f req-0ce642e2-f81a-4fdc-9f8b-1dc6c27737ad service nova] Acquiring lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:58:56 user nova-compute[75993]: DEBUG nova.network.neutron [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.network.neutron [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updating instance_info_cache with network_info: [{"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Releasing lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.compute.manager [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Instance network_info: |[{"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2a12c1b3-ce90-418b-a6cd-a67c0217723f req-0ce642e2-f81a-4fdc-9f8b-1dc6c27737ad service nova] Acquired lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.network.neutron [req-2a12c1b3-ce90-418b-a6cd-a67c0217723f req-0ce642e2-f81a-4fdc-9f8b-1dc6c27737ad service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Refreshing network info cache for port 5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Start _get_guest_xml network_info=[{"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:58:57 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:58:57 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1921205564',display_name='tempest-SnapshotDataIntegrityTests-server-1921205564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1921205564',id=36,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwzI5gTZsbr7sPdrUXSj8v8qT90Xk6gqT27Cf7h59LArD8r8712Wm+GHRmtsDu6scqV9bX282k1iwYTgKwM7fLg+3bACmw7RezOjsOgCgCFLzlcMcNzBVAtDo11YDrj1A==',key_name='tempest-keypair-568980894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63286e9009742619d06722d00a6d99a',ramdisk_id='',reservation_id='r-rbjs6p2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1817277621',owner_user_name='tempest-SnapshotDataIntegrityTests-1817277621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:58:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d3162aaa4874fd98c3bd8a1732a5f9e',uuid=9ca82207-c9df-4e5f-9eae-459397b1a414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Converting VIF {"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=5ab96f99-3763-404e-aceb-1b793e648422,network=Network(7219949b-cb93-4aaf-b575-ad241aa95907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab96f99-37') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.objects.instance [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:58:57 user nova-compute[75993]:   <uuid>9ca82207-c9df-4e5f-9eae-459397b1a414</uuid>
Nov 08 21:58:57 user nova-compute[75993]:   <name>instance-00000024</name>
Nov 08 21:58:57 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:58:57 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:58:57 user nova-compute[75993]:   <metadata>
Nov 08 21:58:57 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:58:57 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:58:57 user nova-compute[75993]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1921205564</nova:name>
Nov 08 21:58:57 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:58:57</nova:creationTime>
Nov 08 21:58:57 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:58:57 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:58:57 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:58:57 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:58:57 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:58:57 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:58:57 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:58:57 user nova-compute[75993]:       <nova:owner>
Nov 08 21:58:57 user nova-compute[75993]:         <nova:user uuid="9d3162aaa4874fd98c3bd8a1732a5f9e">tempest-SnapshotDataIntegrityTests-1817277621-project-member</nova:user>
Nov 08 21:58:57 user nova-compute[75993]:         <nova:project uuid="e63286e9009742619d06722d00a6d99a">tempest-SnapshotDataIntegrityTests-1817277621</nova:project>
Nov 08 21:58:57 user nova-compute[75993]:       </nova:owner>
Nov 08 21:58:57 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:58:57 user nova-compute[75993]:       <nova:ports>
Nov 08 21:58:57 user nova-compute[75993]:         <nova:port uuid="5ab96f99-3763-404e-aceb-1b793e648422">
Nov 08 21:58:57 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 21:58:57 user nova-compute[75993]:         </nova:port>
Nov 08 21:58:57 user nova-compute[75993]:       </nova:ports>
Nov 08 21:58:57 user nova-compute[75993]:     </nova:instance>
Nov 08 21:58:57 user nova-compute[75993]:   </metadata>
Nov 08 21:58:57 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:58:57 user nova-compute[75993]:     <system>
Nov 08 21:58:57 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:58:57 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:58:57 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:58:57 user nova-compute[75993]:       <entry name="serial">9ca82207-c9df-4e5f-9eae-459397b1a414</entry>
Nov 08 21:58:57 user nova-compute[75993]:       <entry name="uuid">9ca82207-c9df-4e5f-9eae-459397b1a414</entry>
Nov 08 21:58:57 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:58:57 user nova-compute[75993]:     </system>
Nov 08 21:58:57 user nova-compute[75993]:   </sysinfo>
Nov 08 21:58:57 user nova-compute[75993]:   <os>
Nov 08 21:58:57 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:58:57 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:58:57 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:58:57 user nova-compute[75993]:   </os>
Nov 08 21:58:57 user nova-compute[75993]:   <features>
Nov 08 21:58:57 user nova-compute[75993]:     <acpi/>
Nov 08 21:58:57 user nova-compute[75993]:     <apic/>
Nov 08 21:58:57 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:58:57 user nova-compute[75993]:   </features>
Nov 08 21:58:57 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:58:57 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:58:57 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:58:57 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:58:57 user nova-compute[75993]:   </clock>
Nov 08 21:58:57 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:58:57 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:58:57 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:58:57 user nova-compute[75993]:   </cpu>
Nov 08 21:58:57 user nova-compute[75993]:   <devices>
Nov 08 21:58:57 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:58:57 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:58:57 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk"/>
Nov 08 21:58:57 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:58:57 user nova-compute[75993]:     </disk>
Nov 08 21:58:57 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:58:57 user nova-compute[75993]:       <mac address="fa:16:3e:bb:b1:a2"/>
Nov 08 21:58:57 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:58:57 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:58:57 user nova-compute[75993]:       <target dev="tap5ab96f99-37"/>
Nov 08 21:58:57 user nova-compute[75993]:     </interface>
Nov 08 21:58:57 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:58:57 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/console.log" append="off"/>
Nov 08 21:58:57 user nova-compute[75993]:     </serial>
Nov 08 21:58:57 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:58:57 user nova-compute[75993]:     <video>
Nov 08 21:58:57 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:58:57 user nova-compute[75993]:     </video>
Nov 08 21:58:57 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:58:57 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:58:57 user nova-compute[75993]:     </rng>
Nov 08 21:58:57 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:58:57 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:58:57 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:58:57 user nova-compute[75993]:     </memballoon>
Nov 08 21:58:57 user nova-compute[75993]:   </devices>
Nov 08 21:58:57 user nova-compute[75993]: </domain>
Nov 08 21:58:57 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1921205564',display_name='tempest-SnapshotDataIntegrityTests-server-1921205564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1921205564',id=36,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwzI5gTZsbr7sPdrUXSj8v8qT90Xk6gqT27Cf7h59LArD8r8712Wm+GHRmtsDu6scqV9bX282k1iwYTgKwM7fLg+3bACmw7RezOjsOgCgCFLzlcMcNzBVAtDo11YDrj1A==',key_name='tempest-keypair-568980894',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e63286e9009742619d06722d00a6d99a',ramdisk_id='',reservation_id='r-rbjs6p2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1817277621',owner_user_name='tempest-SnapshotDataIntegrityTests-1817277621-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:58:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d3162aaa4874fd98c3bd8a1732a5f9e',uuid=9ca82207-c9df-4e5f-9eae-459397b1a414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Converting VIF {"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=5ab96f99-3763-404e-aceb-1b793e648422,network=Network(7219949b-cb93-4aaf-b575-ad241aa95907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab96f99-37') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG os_vif [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=5ab96f99-3763-404e-aceb-1b793e648422,network=Network(7219949b-cb93-4aaf-b575-ad241aa95907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab96f99-37') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6d5ef8e-654c-5b27-9f58-3ffe1b61ef9f', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ab96f99-37, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ab96f99-37, col_values=(('qos', UUID('2634a697-ee66-4bba-a5d1-164681f015ba')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ab96f99-37, col_values=(('external_ids', {'iface-id': '5ab96f99-3763-404e-aceb-1b793e648422', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:b1:a2', 'vm-uuid': '9ca82207-c9df-4e5f-9eae-459397b1a414'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:57 user nova-compute[75993]: INFO os_vif [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=5ab96f99-3763-404e-aceb-1b793e648422,network=Network(7219949b-cb93-4aaf-b575-ad241aa95907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab96f99-37')
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No VIF found with MAC fa:16:3e:bb:b1:a2, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.network.neutron [req-2a12c1b3-ce90-418b-a6cd-a67c0217723f req-0ce642e2-f81a-4fdc-9f8b-1dc6c27737ad service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updated VIF entry in instance network info cache for port 5ab96f99-3763-404e-aceb-1b793e648422. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG nova.network.neutron [req-2a12c1b3-ce90-418b-a6cd-a67c0217723f req-0ce642e2-f81a-4fdc-9f8b-1dc6c27737ad service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updating instance_info_cache with network_info: [{"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:58:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2a12c1b3-ce90-418b-a6cd-a67c0217723f req-0ce642e2-f81a-4fdc-9f8b-1dc6c27737ad service nova] Releasing lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:58:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-345d99f3-5f9f-4c74-9fc5-96d7446c4bf1 req-6f76aa20-d820-41c8-913b-8301d07f558a service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Received event network-vif-plugged-5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:58:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-345d99f3-5f9f-4c74-9fc5-96d7446c4bf1 req-6f76aa20-d820-41c8-913b-8301d07f558a service nova] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:58:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-345d99f3-5f9f-4c74-9fc5-96d7446c4bf1 req-6f76aa20-d820-41c8-913b-8301d07f558a service nova] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:58:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-345d99f3-5f9f-4c74-9fc5-96d7446c4bf1 req-6f76aa20-d820-41c8-913b-8301d07f558a service nova] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:58:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-345d99f3-5f9f-4c74-9fc5-96d7446c4bf1 req-6f76aa20-d820-41c8-913b-8301d07f558a service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] No waiting events found dispatching network-vif-plugged-5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:58:59 user nova-compute[75993]: WARNING nova.compute.manager [req-345d99f3-5f9f-4c74-9fc5-96d7446c4bf1 req-6f76aa20-d820-41c8-913b-8301d07f558a service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Received unexpected event network-vif-plugged-5ab96f99-3763-404e-aceb-1b793e648422 for instance with vm_state building and task_state spawning.
Nov 08 21:58:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:58:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-1b2df24d-b585-4898-821d-a5e633d6e351 req-abae6049-182b-4915-81c2-040f520a23a5 service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Received event network-vif-plugged-5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1b2df24d-b585-4898-821d-a5e633d6e351 req-abae6049-182b-4915-81c2-040f520a23a5 service nova] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1b2df24d-b585-4898-821d-a5e633d6e351 req-abae6049-182b-4915-81c2-040f520a23a5 service nova] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1b2df24d-b585-4898-821d-a5e633d6e351 req-abae6049-182b-4915-81c2-040f520a23a5 service nova] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-1b2df24d-b585-4898-821d-a5e633d6e351 req-abae6049-182b-4915-81c2-040f520a23a5 service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] No waiting events found dispatching network-vif-plugged-5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:59:01 user nova-compute[75993]: WARNING nova.compute.manager [req-1b2df24d-b585-4898-821d-a5e633d6e351 req-abae6049-182b-4915-81c2-040f520a23a5 service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Received unexpected event network-vif-plugged-5ab96f99-3763-404e-aceb-1b793e648422 for instance with vm_state building and task_state spawning.
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.compute.manager [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:59:01 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Instance spawned successfully.
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:01 user nova-compute[75993]: INFO nova.compute.manager [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 08 21:59:01 user nova-compute[75993]: DEBUG nova.compute.manager [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:59:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:01 user nova-compute[75993]: INFO nova.compute.manager [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Took 7.11 seconds to build instance.
Nov 08 21:59:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-214e289f-b050-4b74-8cdb-f485a52018d0 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.214s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:04 user nova-compute[75993]: INFO nova.compute.manager [None req-86abd78a-3698-43cc-a584-9efd939a0024 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Unrescuing
Nov 08 21:59:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-86abd78a-3698-43cc-a584-9efd939a0024 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:59:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-86abd78a-3698-43cc-a584-9efd939a0024 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquired lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:59:04 user nova-compute[75993]: DEBUG nova.network.neutron [None req-86abd78a-3698-43cc-a584-9efd939a0024 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:59:04 user nova-compute[75993]: DEBUG nova.network.neutron [None req-86abd78a-3698-43cc-a584-9efd939a0024 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Updating instance_info_cache with network_info: [{"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:59:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-86abd78a-3698-43cc-a584-9efd939a0024 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Releasing lock "refresh_cache-d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:59:04 user nova-compute[75993]: DEBUG nova.objects.instance [None req-86abd78a-3698-43cc-a584-9efd939a0024 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'flavor' on Instance uuid d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:59:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-eab9e702-485f-4ff5-a611-e180d01a61b1 req-cd61874a-4d4b-48e9-9e7b-507a6b623745 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-unplugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:59:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eab9e702-485f-4ff5-a611-e180d01a61b1 req-cd61874a-4d4b-48e9-9e7b-507a6b623745 service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eab9e702-485f-4ff5-a611-e180d01a61b1 req-cd61874a-4d4b-48e9-9e7b-507a6b623745 service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eab9e702-485f-4ff5-a611-e180d01a61b1 req-cd61874a-4d4b-48e9-9e7b-507a6b623745 service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-eab9e702-485f-4ff5-a611-e180d01a61b1 req-cd61874a-4d4b-48e9-9e7b-507a6b623745 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-unplugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:59:05 user nova-compute[75993]: WARNING nova.compute.manager [req-eab9e702-485f-4ff5-a611-e180d01a61b1 req-cd61874a-4d4b-48e9-9e7b-507a6b623745 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received unexpected event network-vif-unplugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:59:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:05 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:59:05 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Instance destroyed successfully.
Nov 08 21:59:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-f42006b7-a438-4b31-acca-2716183d704d req-5e6213ad-f414-466d-b050-435b2d85d01f service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:59:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f42006b7-a438-4b31-acca-2716183d704d req-5e6213ad-f414-466d-b050-435b2d85d01f service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f42006b7-a438-4b31-acca-2716183d704d req-5e6213ad-f414-466d-b050-435b2d85d01f service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f42006b7-a438-4b31-acca-2716183d704d req-5e6213ad-f414-466d-b050-435b2d85d01f service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-f42006b7-a438-4b31-acca-2716183d704d req-5e6213ad-f414-466d-b050-435b2d85d01f service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:59:07 user nova-compute[75993]: WARNING nova.compute.manager [req-f42006b7-a438-4b31-acca-2716183d704d req-5e6213ad-f414-466d-b050-435b2d85d01f service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received unexpected event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:59:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:59:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 21:59:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 21:59:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:59:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:59:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 21:59:08 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 1f2e921c-69cc-496c-9e19-561dcfd00a72 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Updating instance_info_cache with network_info: [{"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-1f2e921c-69cc-496c-9e19-561dcfd00a72" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:59:09 user nova-compute[75993]: WARNING nova.compute.manager [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received unexpected event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:59:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:59:09 user nova-compute[75993]: WARNING nova.compute.manager [req-c86fe70d-4750-43e9-848e-0b714db7d0c8 req-54ad2ab8-45ad-4d73-a3f6-88f5a61becc3 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received unexpected event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with vm_state rescued and task_state unrescuing.
Nov 08 21:59:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-86abd78a-3698-43cc-a584-9efd939a0024 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 21:59:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:12 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:59:12 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7970MB free_disk=24.834041595458984GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Applying migration context for instance d5fe6095-7bc6-48ae-b858-5ea2148ee423 as it has an incoming, in-progress migration 50371352-5231-4537-9a79-aaf579522acd. Migration status is finished {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 08 21:59:12 user nova-compute[75993]: INFO nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating resource usage from migration 50371352-5231-4537-9a79-aaf579522acd
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Migration 50371352-5231-4537-9a79-aaf579522acd is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d5fe6095-7bc6-48ae-b858-5ea2148ee423 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 4cf75975-1760-4697-8186-87ccee8ae77b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9ca82207-c9df-4e5f-9eae-459397b1a414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 21:59:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.669s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:59:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:59:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:59:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 21:59:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:59:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Going to confirm migration 2 {{(pid=75993) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquired lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG nova.objects.instance [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'info_cache' on Instance uuid d5fe6095-7bc6-48ae-b858-5ea2148ee423 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating instance_info_cache with network_info: [{"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Releasing lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG nova.objects.instance [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'migration_context' on Instance uuid d5fe6095-7bc6-48ae-b858-5ea2148ee423 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG nova.objects.base [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Object Instance<d5fe6095-7bc6-48ae-b858-5ea2148ee423> lazy-loaded attributes: info_cache,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:34 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:59:34 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:59:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.320s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:34 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Deleted allocation for migration 50371352-5231-4537-9a79-aaf579522acd
Nov 08 21:59:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-9e3cbfce-4e32-4e67-a0fb-b47d25a46701 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.247s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Acquiring lock "b1fa9fef-15d1-457f-955d-887fc358d4a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 21:59:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 21:59:41 user nova-compute[75993]: INFO nova.compute.claims [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Claim successful on node user
Nov 08 21:59:42 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 21:59:42 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 21:59:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG nova.policy [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '654d309e17344aaab4dab13efdee85d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd85d2b73579643af9f4b9720cb4c2ac6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 21:59:42 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Creating image(s)
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "/opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "/opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.206s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.191s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk 1073741824" returned: 0 in 0.054s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.170s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 21:59:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Cannot resize image /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Ensure instance console log exists: /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Successfully created port: 226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Successfully updated port: 226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Acquiring lock "refresh_cache-b1fa9fef-15d1-457f-955d-887fc358d4a3" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Acquired lock "refresh_cache-b1fa9fef-15d1-457f-955d-887fc358d4a3" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:59:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-bf755bed-cf40-4a8c-9af1-21b6b333e2d2 req-9876aa61-ef64-40ab-b625-1ad8d27ac571 service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Received event network-changed-226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-bf755bed-cf40-4a8c-9af1-21b6b333e2d2 req-9876aa61-ef64-40ab-b625-1ad8d27ac571 service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Refreshing instance network info cache due to event network-changed-226fccc2-0a16-4ece-9718-c56e1bad8358. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bf755bed-cf40-4a8c-9af1-21b6b333e2d2 req-9876aa61-ef64-40ab-b625-1ad8d27ac571 service nova] Acquiring lock "refresh_cache-b1fa9fef-15d1-457f-955d-887fc358d4a3" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Updating instance_info_cache with network_info: [{"id": "226fccc2-0a16-4ece-9718-c56e1bad8358", "address": "fa:16:3e:d1:b8:90", "network": {"id": "b8483ba3-7547-4fef-9fb5-e13da22289eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "595af569c4ed47aa9b06f30e79e17e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226fccc2-0a", "ovs_interfaceid": "226fccc2-0a16-4ece-9718-c56e1bad8358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Releasing lock "refresh_cache-b1fa9fef-15d1-457f-955d-887fc358d4a3" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Instance network_info: |[{"id": "226fccc2-0a16-4ece-9718-c56e1bad8358", "address": "fa:16:3e:d1:b8:90", "network": {"id": "b8483ba3-7547-4fef-9fb5-e13da22289eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "595af569c4ed47aa9b06f30e79e17e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226fccc2-0a", "ovs_interfaceid": "226fccc2-0a16-4ece-9718-c56e1bad8358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bf755bed-cf40-4a8c-9af1-21b6b333e2d2 req-9876aa61-ef64-40ab-b625-1ad8d27ac571 service nova] Acquired lock "refresh_cache-b1fa9fef-15d1-457f-955d-887fc358d4a3" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-bf755bed-cf40-4a8c-9af1-21b6b333e2d2 req-9876aa61-ef64-40ab-b625-1ad8d27ac571 service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Refreshing network info cache for port 226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Start _get_guest_xml network_info=[{"id": "226fccc2-0a16-4ece-9718-c56e1bad8358", "address": "fa:16:3e:d1:b8:90", "network": {"id": "b8483ba3-7547-4fef-9fb5-e13da22289eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "595af569c4ed47aa9b06f30e79e17e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226fccc2-0a", "ovs_interfaceid": "226fccc2-0a16-4ece-9718-c56e1bad8358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 21:59:44 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:59:44 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1301524366',display_name='tempest-VolumesNegativeTest-instance-1301524366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1301524366',id=37,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d85d2b73579643af9f4b9720cb4c2ac6',ramdisk_id='',reservation_id='r-w1rhc2u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1103490924',owner_user_name='tempest-VolumesNegativeTest-1103490924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:59:42Z,user_data=None,user_id='654d309e17344aaab4dab13efdee85d1',uuid=b1fa9fef-15d1-457f-955d-887fc358d4a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "226fccc2-0a16-4ece-9718-c56e1bad8358", "address": "fa:16:3e:d1:b8:90", "network": {"id": "b8483ba3-7547-4fef-9fb5-e13da22289eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "595af569c4ed47aa9b06f30e79e17e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226fccc2-0a", "ovs_interfaceid": "226fccc2-0a16-4ece-9718-c56e1bad8358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Converting VIF {"id": "226fccc2-0a16-4ece-9718-c56e1bad8358", "address": "fa:16:3e:d1:b8:90", "network": {"id": "b8483ba3-7547-4fef-9fb5-e13da22289eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "595af569c4ed47aa9b06f30e79e17e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226fccc2-0a", "ovs_interfaceid": "226fccc2-0a16-4ece-9718-c56e1bad8358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=226fccc2-0a16-4ece-9718-c56e1bad8358,network=Network(b8483ba3-7547-4fef-9fb5-e13da22289eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226fccc2-0a') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lazy-loading 'pci_devices' on Instance uuid b1fa9fef-15d1-457f-955d-887fc358d4a3 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] End _get_guest_xml xml=<domain type="kvm">
Nov 08 21:59:44 user nova-compute[75993]:   <uuid>b1fa9fef-15d1-457f-955d-887fc358d4a3</uuid>
Nov 08 21:59:44 user nova-compute[75993]:   <name>instance-00000025</name>
Nov 08 21:59:44 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 21:59:44 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 21:59:44 user nova-compute[75993]:   <metadata>
Nov 08 21:59:44 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 21:59:44 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 21:59:44 user nova-compute[75993]:       <nova:name>tempest-VolumesNegativeTest-instance-1301524366</nova:name>
Nov 08 21:59:44 user nova-compute[75993]:       <nova:creationTime>2023-11-08 21:59:44</nova:creationTime>
Nov 08 21:59:44 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 21:59:44 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 21:59:44 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 21:59:44 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 21:59:44 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 21:59:44 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 21:59:44 user nova-compute[75993]:       </nova:flavor>
Nov 08 21:59:44 user nova-compute[75993]:       <nova:owner>
Nov 08 21:59:44 user nova-compute[75993]:         <nova:user uuid="654d309e17344aaab4dab13efdee85d1">tempest-VolumesNegativeTest-1103490924-project-member</nova:user>
Nov 08 21:59:44 user nova-compute[75993]:         <nova:project uuid="d85d2b73579643af9f4b9720cb4c2ac6">tempest-VolumesNegativeTest-1103490924</nova:project>
Nov 08 21:59:44 user nova-compute[75993]:       </nova:owner>
Nov 08 21:59:44 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 21:59:44 user nova-compute[75993]:       <nova:ports>
Nov 08 21:59:44 user nova-compute[75993]:         <nova:port uuid="226fccc2-0a16-4ece-9718-c56e1bad8358">
Nov 08 21:59:44 user nova-compute[75993]:           <nova:ip type="fixed" address="192.168.233.39" ipVersion="4"/>
Nov 08 21:59:44 user nova-compute[75993]:         </nova:port>
Nov 08 21:59:44 user nova-compute[75993]:       </nova:ports>
Nov 08 21:59:44 user nova-compute[75993]:     </nova:instance>
Nov 08 21:59:44 user nova-compute[75993]:   </metadata>
Nov 08 21:59:44 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 21:59:44 user nova-compute[75993]:     <system>
Nov 08 21:59:44 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 21:59:44 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 21:59:44 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 21:59:44 user nova-compute[75993]:       <entry name="serial">b1fa9fef-15d1-457f-955d-887fc358d4a3</entry>
Nov 08 21:59:44 user nova-compute[75993]:       <entry name="uuid">b1fa9fef-15d1-457f-955d-887fc358d4a3</entry>
Nov 08 21:59:44 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 21:59:44 user nova-compute[75993]:     </system>
Nov 08 21:59:44 user nova-compute[75993]:   </sysinfo>
Nov 08 21:59:44 user nova-compute[75993]:   <os>
Nov 08 21:59:44 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 21:59:44 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 21:59:44 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 21:59:44 user nova-compute[75993]:   </os>
Nov 08 21:59:44 user nova-compute[75993]:   <features>
Nov 08 21:59:44 user nova-compute[75993]:     <acpi/>
Nov 08 21:59:44 user nova-compute[75993]:     <apic/>
Nov 08 21:59:44 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 21:59:44 user nova-compute[75993]:   </features>
Nov 08 21:59:44 user nova-compute[75993]:   <clock offset="utc">
Nov 08 21:59:44 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 21:59:44 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 21:59:44 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 21:59:44 user nova-compute[75993]:   </clock>
Nov 08 21:59:44 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 21:59:44 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 21:59:44 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 21:59:44 user nova-compute[75993]:   </cpu>
Nov 08 21:59:44 user nova-compute[75993]:   <devices>
Nov 08 21:59:44 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 21:59:44 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 21:59:44 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk"/>
Nov 08 21:59:44 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 21:59:44 user nova-compute[75993]:     </disk>
Nov 08 21:59:44 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 21:59:44 user nova-compute[75993]:       <mac address="fa:16:3e:d1:b8:90"/>
Nov 08 21:59:44 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:59:44 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 21:59:44 user nova-compute[75993]:       <target dev="tap226fccc2-0a"/>
Nov 08 21:59:44 user nova-compute[75993]:     </interface>
Nov 08 21:59:44 user nova-compute[75993]:     <serial type="pty">
Nov 08 21:59:44 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/console.log" append="off"/>
Nov 08 21:59:44 user nova-compute[75993]:     </serial>
Nov 08 21:59:44 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 21:59:44 user nova-compute[75993]:     <video>
Nov 08 21:59:44 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 21:59:44 user nova-compute[75993]:     </video>
Nov 08 21:59:44 user nova-compute[75993]:     <rng model="virtio">
Nov 08 21:59:44 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 21:59:44 user nova-compute[75993]:     </rng>
Nov 08 21:59:44 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 21:59:44 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 21:59:44 user nova-compute[75993]:       <stats period="10"/>
Nov 08 21:59:44 user nova-compute[75993]:     </memballoon>
Nov 08 21:59:44 user nova-compute[75993]:   </devices>
Nov 08 21:59:44 user nova-compute[75993]: </domain>
Nov 08 21:59:44 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1301524366',display_name='tempest-VolumesNegativeTest-instance-1301524366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1301524366',id=37,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d85d2b73579643af9f4b9720cb4c2ac6',ramdisk_id='',reservation_id='r-w1rhc2u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1103490924',owner_user_name='tempest-VolumesNegativeTest-1103490924-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T21:59:42Z,user_data=None,user_id='654d309e17344aaab4dab13efdee85d1',uuid=b1fa9fef-15d1-457f-955d-887fc358d4a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "226fccc2-0a16-4ece-9718-c56e1bad8358", "address": "fa:16:3e:d1:b8:90", "network": {"id": "b8483ba3-7547-4fef-9fb5-e13da22289eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "595af569c4ed47aa9b06f30e79e17e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226fccc2-0a", "ovs_interfaceid": "226fccc2-0a16-4ece-9718-c56e1bad8358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Converting VIF {"id": "226fccc2-0a16-4ece-9718-c56e1bad8358", "address": "fa:16:3e:d1:b8:90", "network": {"id": "b8483ba3-7547-4fef-9fb5-e13da22289eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "595af569c4ed47aa9b06f30e79e17e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226fccc2-0a", "ovs_interfaceid": "226fccc2-0a16-4ece-9718-c56e1bad8358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=226fccc2-0a16-4ece-9718-c56e1bad8358,network=Network(b8483ba3-7547-4fef-9fb5-e13da22289eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226fccc2-0a') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG os_vif [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=226fccc2-0a16-4ece-9718-c56e1bad8358,network=Network(b8483ba3-7547-4fef-9fb5-e13da22289eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226fccc2-0a') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e3bcff0-bbd1-554c-be4c-8311d5e849cf', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap226fccc2-0a, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap226fccc2-0a, col_values=(('qos', UUID('9fdfa050-f3bf-4bd0-b1ac-69f48d3f9656')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap226fccc2-0a, col_values=(('external_ids', {'iface-id': '226fccc2-0a16-4ece-9718-c56e1bad8358', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:b8:90', 'vm-uuid': 'b1fa9fef-15d1-457f-955d-887fc358d4a3'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:44 user nova-compute[75993]: INFO os_vif [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=226fccc2-0a16-4ece-9718-c56e1bad8358,network=Network(b8483ba3-7547-4fef-9fb5-e13da22289eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226fccc2-0a')
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] No VIF found with MAC fa:16:3e:d1:b8:90, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-bf755bed-cf40-4a8c-9af1-21b6b333e2d2 req-9876aa61-ef64-40ab-b625-1ad8d27ac571 service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Updated VIF entry in instance network info cache for port 226fccc2-0a16-4ece-9718-c56e1bad8358. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-bf755bed-cf40-4a8c-9af1-21b6b333e2d2 req-9876aa61-ef64-40ab-b625-1ad8d27ac571 service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Updating instance_info_cache with network_info: [{"id": "226fccc2-0a16-4ece-9718-c56e1bad8358", "address": "fa:16:3e:d1:b8:90", "network": {"id": "b8483ba3-7547-4fef-9fb5-e13da22289eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "595af569c4ed47aa9b06f30e79e17e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226fccc2-0a", "ovs_interfaceid": "226fccc2-0a16-4ece-9718-c56e1bad8358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 21:59:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bf755bed-cf40-4a8c-9af1-21b6b333e2d2 req-9876aa61-ef64-40ab-b625-1ad8d27ac571 service nova] Releasing lock "refresh_cache-b1fa9fef-15d1-457f-955d-887fc358d4a3" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 21:59:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-c99846b9-f7a1-4d6a-a252-b5901b9dd77d req-ab708a70-71e0-4f80-9e95-71a0dd341be1 service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Received event network-vif-plugged-226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:59:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c99846b9-f7a1-4d6a-a252-b5901b9dd77d req-ab708a70-71e0-4f80-9e95-71a0dd341be1 service nova] Acquiring lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c99846b9-f7a1-4d6a-a252-b5901b9dd77d req-ab708a70-71e0-4f80-9e95-71a0dd341be1 service nova] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c99846b9-f7a1-4d6a-a252-b5901b9dd77d req-ab708a70-71e0-4f80-9e95-71a0dd341be1 service nova] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-c99846b9-f7a1-4d6a-a252-b5901b9dd77d req-ab708a70-71e0-4f80-9e95-71a0dd341be1 service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] No waiting events found dispatching network-vif-plugged-226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:59:46 user nova-compute[75993]: WARNING nova.compute.manager [req-c99846b9-f7a1-4d6a-a252-b5901b9dd77d req-ab708a70-71e0-4f80-9e95-71a0dd341be1 service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Received unexpected event network-vif-plugged-226fccc2-0a16-4ece-9718-c56e1bad8358 for instance with vm_state building and task_state spawning.
Nov 08 21:59:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 21:59:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Instance spawned successfully.
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-90798a5e-79d0-4263-8113-117fb7cdf103 req-284606c1-82a7-4bd3-b3d6-0ce74f13d26a service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Received event network-vif-plugged-226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-90798a5e-79d0-4263-8113-117fb7cdf103 req-284606c1-82a7-4bd3-b3d6-0ce74f13d26a service nova] Acquiring lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-90798a5e-79d0-4263-8113-117fb7cdf103 req-284606c1-82a7-4bd3-b3d6-0ce74f13d26a service nova] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-90798a5e-79d0-4263-8113-117fb7cdf103 req-284606c1-82a7-4bd3-b3d6-0ce74f13d26a service nova] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-90798a5e-79d0-4263-8113-117fb7cdf103 req-284606c1-82a7-4bd3-b3d6-0ce74f13d26a service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] No waiting events found dispatching network-vif-plugged-226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 21:59:48 user nova-compute[75993]: WARNING nova.compute.manager [req-90798a5e-79d0-4263-8113-117fb7cdf103 req-284606c1-82a7-4bd3-b3d6-0ce74f13d26a service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Received unexpected event network-vif-plugged-226fccc2-0a16-4ece-9718-c56e1bad8358 for instance with vm_state building and task_state spawning.
Nov 08 21:59:48 user nova-compute[75993]: INFO nova.compute.manager [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 08 21:59:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 21:59:48 user nova-compute[75993]: INFO nova.compute.manager [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Took 6.69 seconds to build instance.
Nov 08 21:59:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f758c4c5-84e8-44f8-af54-80e59a9aae69 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.789s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 21:59:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 21:59:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 21:59:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:00:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:00:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:00:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:00:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:00:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:06 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:00:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updating instance_info_cache with network_info: [{"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-91fae199-114f-4f67-b48d-1e74ede28d32" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:00:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:00:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:13 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:00:13 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:00:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7695MB free_disk=24.767902374267578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:00:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d5fe6095-7bc6-48ae-b858-5ea2148ee423 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 4cf75975-1760-4697-8186-87ccee8ae77b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9ca82207-c9df-4e5f-9eae-459397b1a414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance b1fa9fef-15d1-457f-955d-887fc358d4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.799s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:00:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:18 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:20 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:22 user nova-compute[75993]: DEBUG nova.objects.instance [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'flavor' on Instance uuid 4cf75975-1760-4697-8186-87ccee8ae77b {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:00:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:23 user nova-compute[75993]: INFO nova.compute.manager [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Attaching volume beeaee07-ffb5-481f-9efb-485ae23da7f9 to /dev/vdb
Nov 08 22:00:23 user nova-compute[75993]: DEBUG os_brick.utils [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaab8d6d-d358-454b-bd43-bb6db9a6cac5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a338231-88ae-4661-920e-cda4329efb0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d082493-102a-4ed5-8dfa-01feebf318c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5df30d8-babd-4c32-ac83-8374ccd70c78]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:00:23 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[823cda4d-8783-459b-93f8-2e77a8087a91]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG os_brick.utils [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updating existing volume attachment record: 7784a602-ab14-479a-982c-64ef9d7a7d83 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 22:00:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:26 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 22:00:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 22:00:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:00:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:00:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:00:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:00:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:33 user nova-compute[75993]: INFO nova.compute.manager [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Unshelving
Nov 08 22:00:33 user nova-compute[75993]: INFO nova.virt.block_device [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Booting with volume 32658f8f-79d5-4fec-8cc0-db9c0142af76 at /dev/vda
Nov 08 22:00:33 user nova-compute[75993]: DEBUG os_brick.utils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbd0893-5d72-4a33-b0b5-f7aa6e7bb6e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79857a4-9392-45e5-8fd3-f5b7e8acc1c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d23010-68e5-4c5f-94cb-a17b0cc53d47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e8dea6-060e-4334-8347-db40ef6448d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:00:33 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:00:33 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cb7a3b-9c28-49c3-b56a-42da14abd73e]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG os_brick.utils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:00:33 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating existing volume attachment record: d71d1d90-ef0a-472a-9293-f34de466e7e8 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:00:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:00:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:00:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:00:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:00:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:36 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:00:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:00:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:00:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:00:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:00:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:00:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:00:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:00:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-9e1e5679-15e7-4408-9047-c17ac2d92e14 req-d7e151e0-779b-40a3-810b-91b4fdfe6aea service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Received event network-changed-5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:00:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-9e1e5679-15e7-4408-9047-c17ac2d92e14 req-d7e151e0-779b-40a3-810b-91b4fdfe6aea service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Refreshing instance network info cache due to event network-changed-5ab96f99-3763-404e-aceb-1b793e648422. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:00:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9e1e5679-15e7-4408-9047-c17ac2d92e14 req-d7e151e0-779b-40a3-810b-91b4fdfe6aea service nova] Acquiring lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:00:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9e1e5679-15e7-4408-9047-c17ac2d92e14 req-d7e151e0-779b-40a3-810b-91b4fdfe6aea service nova] Acquired lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:00:45 user nova-compute[75993]: DEBUG nova.network.neutron [req-9e1e5679-15e7-4408-9047-c17ac2d92e14 req-d7e151e0-779b-40a3-810b-91b4fdfe6aea service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Refreshing network info cache for port 5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:00:45 user nova-compute[75993]: DEBUG nova.network.neutron [req-9e1e5679-15e7-4408-9047-c17ac2d92e14 req-d7e151e0-779b-40a3-810b-91b4fdfe6aea service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updated VIF entry in instance network info cache for port 5ab96f99-3763-404e-aceb-1b793e648422. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:00:45 user nova-compute[75993]: DEBUG nova.network.neutron [req-9e1e5679-15e7-4408-9047-c17ac2d92e14 req-d7e151e0-779b-40a3-810b-91b4fdfe6aea service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updating instance_info_cache with network_info: [{"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:00:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9e1e5679-15e7-4408-9047-c17ac2d92e14 req-d7e151e0-779b-40a3-810b-91b4fdfe6aea service nova] Releasing lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:00:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMDVhJcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:00:47 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:00:47 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:00:47 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d410de-3bd3-4435-afc9-59881e895342]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:00:47 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b1a5f4-67d6-4f07-a450-539cadd13e14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9] added
Nov 08 22:00:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c9f890-aa3f-4247-92d8-b0832c3a3d5b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[461f344b-df40-40e4-9821-f50f2928801c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMDVhJcT {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fMDVhJcT" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef2a5c1-06fa-400a-9318-d2a4a8d8f342]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fMDVhJcT'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece33e8a-63a5-416e-8b1a-7db4ff46a80f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[845241fd-afaf-423e-9558-4d32ee97779f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:00:47 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 22:00:47 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:00:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:00:47 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 22:00:47 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:00:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb974f-357b-4df7-9a09-df9e8c59b5d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9, portal: 172.16.0.220,3260]
Nov 08 22:00:47 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9, portal: 172.16.0.220,3260] successful.
Nov 08 22:00:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[714390e7-0da6-4857-9716-8c7a625cf936]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b1b7d3-b716-4d6a-9a15-938c276bb435]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:00:47 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 22:00:47 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:00:47 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:00:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:00:47 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 22:00:47 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:00:47 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:00:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06be85e-db8b-4340-a655-c30c140f0a37]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:00:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMDVhJcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:00:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:00:48 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23961646639323333', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:00:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961646639323333', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:00:48 user nova-compute[75993]: DEBUG nova.objects.instance [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'flavor' on Instance uuid 4cf75975-1760-4697-8186-87ccee8ae77b {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:00:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 22:00:48 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:00:48 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 22:00:48 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:00:48 user nova-compute[75993]:   <serial>beeaee07-ffb5-481f-9efb-485ae23da7f9</serial>
Nov 08 22:00:48 user nova-compute[75993]: </disk>
Nov 08 22:00:48 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 22:00:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:00:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:00:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] No VIF found with MAC fa:16:3e:2e:f7:31, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:00:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d62bfbfc-422f-4d95-98bd-df4bc3d6f934 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.891s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-6e731546-00ed-43c1-9db7-3b3f975ebff6 req-8cc7abbe-467c-450c-85cd-3dd4e4a06a1a service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-changed-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-6e731546-00ed-43c1-9db7-3b3f975ebff6 req-8cc7abbe-467c-450c-85cd-3dd4e4a06a1a service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Refreshing instance network info cache due to event network-changed-95040a92-cb5d-43b2-9a5a-c54f134f28f6. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6e731546-00ed-43c1-9db7-3b3f975ebff6 req-8cc7abbe-467c-450c-85cd-3dd4e4a06a1a service nova] Acquiring lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6e731546-00ed-43c1-9db7-3b3f975ebff6 req-8cc7abbe-467c-450c-85cd-3dd4e4a06a1a service nova] Acquired lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG nova.network.neutron [req-6e731546-00ed-43c1-9db7-3b3f975ebff6 req-8cc7abbe-467c-450c-85cd-3dd4e4a06a1a service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Refreshing network info cache for port 95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG nova.objects.instance [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG nova.network.neutron [req-6e731546-00ed-43c1-9db7-3b3f975ebff6 req-8cc7abbe-467c-450c-85cd-3dd4e4a06a1a service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updated VIF entry in instance network info cache for port 95040a92-cb5d-43b2-9a5a-c54f134f28f6. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG nova.network.neutron [req-6e731546-00ed-43c1-9db7-3b3f975ebff6 req-8cc7abbe-467c-450c-85cd-3dd4e4a06a1a service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updating instance_info_cache with network_info: [{"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6e731546-00ed-43c1-9db7-3b3f975ebff6 req-8cc7abbe-467c-450c-85cd-3dd4e4a06a1a service nova] Releasing lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:52 user nova-compute[75993]: INFO nova.compute.manager [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attaching volume 21482176-527a-427e-87a5-6cad41acc414 to /dev/vdb
Nov 08 22:00:52 user nova-compute[75993]: DEBUG os_brick.utils [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a02f9c-8d26-45fe-a069-d6b8cbe8c4f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac1c6e4-b429-4001-8566-6d7c78d1b475]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ba153-1069-4bad-8aec-e62dd5605a75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cf1f6f-0db9-4e44-aae0-43abe15be77c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:00:52 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:00:52 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4add3e5-2797-4732-824c-69883b54a528]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG os_brick.utils [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:00:52 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updating existing volume attachment record: 09276e89-0b30-48e2-8b6f-4361bc16ba63 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 1f2e921c-69cc-496c-9e19-561dcfd00a72 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 91fae199-114f-4f67-b48d-1e74ede28d32 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 64d8c15c-0ac9-434b-852a-123a940dc0ae {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid d5fe6095-7bc6-48ae-b858-5ea2148ee423 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 4cf75975-1760-4697-8186-87ccee8ae77b {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid b1fa9fef-15d1-457f-955d-887fc358d4a3 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "91fae199-114f-4f67-b48d-1e74ede28d32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "b1fa9fef-15d1-457f-955d-887fc358d4a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "91fae199-114f-4f67-b48d-1e74ede28d32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:54 user nova-compute[75993]: DEBUG nova.compute.manager [req-4df2b181-498d-4f2d-b755-d980bc0129fe req-f044dbe3-412c-4e8d-8351-95e3f18a4e84 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-changed-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:00:54 user nova-compute[75993]: DEBUG nova.compute.manager [req-4df2b181-498d-4f2d-b755-d980bc0129fe req-f044dbe3-412c-4e8d-8351-95e3f18a4e84 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Refreshing instance network info cache due to event network-changed-95040a92-cb5d-43b2-9a5a-c54f134f28f6. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:00:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4df2b181-498d-4f2d-b755-d980bc0129fe req-f044dbe3-412c-4e8d-8351-95e3f18a4e84 service nova] Acquiring lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:00:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4df2b181-498d-4f2d-b755-d980bc0129fe req-f044dbe3-412c-4e8d-8351-95e3f18a4e84 service nova] Acquired lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:00:54 user nova-compute[75993]: DEBUG nova.network.neutron [req-4df2b181-498d-4f2d-b755-d980bc0129fe req-f044dbe3-412c-4e8d-8351-95e3f18a4e84 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Refreshing network info cache for port 95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:00:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:54 user nova-compute[75993]: DEBUG nova.network.neutron [req-4df2b181-498d-4f2d-b755-d980bc0129fe req-f044dbe3-412c-4e8d-8351-95e3f18a4e84 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updated VIF entry in instance network info cache for port 95040a92-cb5d-43b2-9a5a-c54f134f28f6. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:00:54 user nova-compute[75993]: DEBUG nova.network.neutron [req-4df2b181-498d-4f2d-b755-d980bc0129fe req-f044dbe3-412c-4e8d-8351-95e3f18a4e84 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updating instance_info_cache with network_info: [{"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:00:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4df2b181-498d-4f2d-b755-d980bc0129fe req-f044dbe3-412c-4e8d-8351-95e3f18a4e84 service nova] Releasing lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:00:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:54 user nova-compute[75993]: INFO nova.compute.manager [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Rebooting instance
Nov 08 22:00:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:00:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquired lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:00:55 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:00:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:55 user nova-compute[75993]: INFO nova.compute.manager [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Terminating instance
Nov 08 22:00:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:00:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updating instance_info_cache with network_info: [{"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Releasing lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:00:56 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Instance destroyed successfully.
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.objects.instance [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'resources' on Instance uuid d4f0f927-23ad-4f92-acbb-cf6757f9c4e9 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1834406264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1834406264',id=32,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:57:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-4tl9r080',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:59:09Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=d4f0f927-23ad-4f92-acbb-cf6757f9c4e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "cafc456a-96ff-4e51-b0d5-9237991809c7", "address": "fa:16:3e:00:f6:55", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcafc456a-96", "ovs_interfaceid": "cafc456a-96ff-4e51-b0d5-9237991809c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:f6:55,bridge_name='br-int',has_traffic_filtering=True,id=cafc456a-96ff-4e51-b0d5-9237991809c7,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafc456a-96') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_vif [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:f6:55,bridge_name='br-int',has_traffic_filtering=True,id=cafc456a-96ff-4e51-b0d5-9237991809c7,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafc456a-96') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcafc456a-96, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74306b0f-bde0-42b1-86bb-167234b066b2) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:56 user nova-compute[75993]: INFO os_vif [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:f6:55,bridge_name='br-int',has_traffic_filtering=True,id=cafc456a-96ff-4e51-b0d5-9237991809c7,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcafc456a-96')
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YCqrJaId', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:00:56 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[366c779a-2a66-4e74-a872-0563912a2da0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:00:56 user nova-compute[75993]: No targets found.
Nov 08 22:00:56 user nova-compute[75993]: iSNS:
Nov 08 22:00:56 user nova-compute[75993]: No targets found.
Nov 08 22:00:56 user nova-compute[75993]: STATIC:
Nov 08 22:00:56 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 22:00:56 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:00:56 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:00:56 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d
Nov 08 22:00:56 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:00:56 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:00:56 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9
Nov 08 22:00:56 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:00:56 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:00:56 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4
Nov 08 22:00:56 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:00:56 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:00:56 user nova-compute[75993]: FIRMWARE:
Nov 08 22:00:56 user nova-compute[75993]: No targets found.
Nov 08 22:00:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:00:56 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:00:56 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5de533-943a-459c-9c74-96bf8c5387c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d0c571-7cb3-4da2-b94b-3416f7927b5d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:00:56 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 22:00:56 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:00:56 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:00:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:00:56 user nova-compute[75993]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d (non-flash)
Nov 08 22:00:56 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:00:56 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:00:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544dd0820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcba525-9966-4e4a-9d53-218ca6ccfcfc]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[144669f4-11c2-4d07-9e2c-3fd5d7bd85ec]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e758543e-3ed8-4a6c-ab88-81f8b46a2409]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1efeeb-45b2-476d-97a5-925e89f39531]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a988d306', '/dev/disk/by-id/scsi-26134653161363662', '/dev/disk/by-id/scsi-1SCST_BIOa988d306-a4e1a66be088feee') {{(pid=86999) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2dc4ab-a243-4f26-832b-35b2ab048e29]: (4, None) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b471e02b-2a63-453f-82a1-a61d0cf394cb]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-unplugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-unplugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-unplugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] Acquiring lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] No waiting events found dispatching network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:00:56 user nova-compute[75993]: WARNING nova.compute.manager [req-899c2213-d7ea-4287-8540-1812ce8069e9 req-8cdb06ba-ed46-4721-83fa-8a900512678b service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received unexpected event network-vif-plugged-cafc456a-96ff-4e51-b0d5-9237991809c7 for instance with vm_state active and task_state deleting.
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6def85-f178-451f-a789-8b489f2f6dd3]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d, portal: 172.16.0.220,3260]
Nov 08 22:00:56 user nova-compute[75993]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d, portal: 172.16.0.220,3260] successful.
Nov 08 22:00:56 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c697987-9d0d-43f4-9772-a6b24a15559d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65fe08b-dca8-4d24-8084-660cb2a42fd3]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] <== disconnect_volume: return (382ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:00:56 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Deleting instance files /opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9_del
Nov 08 22:00:56 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Deletion of /opt/stack/data/nova/instances/d4f0f927-23ad-4f92-acbb-cf6757f9c4e9_del complete
Nov 08 22:00:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:56 user nova-compute[75993]: INFO nova.compute.manager [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 08 22:00:56 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:00:56 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:00:57 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:00:57 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Took 0.44 seconds to deallocate network for instance.
Nov 08 22:00:58 user nova-compute[75993]: INFO nova.compute.manager [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Took 0.92 seconds to detach 1 volumes for instance.
Nov 08 22:00:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:00:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:00:58 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:00:58 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:00:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:58 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Deleted allocations for instance d4f0f927-23ad-4f92-acbb-cf6757f9c4e9
Nov 08 22:00:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-9e2385d4-ffb6-47de-b15f-45b32618c8f6 req-0bfdc2b2-9d8e-4053-95ec-39612eac6ca1 service nova] [instance: d4f0f927-23ad-4f92-acbb-cf6757f9c4e9] Received event network-vif-deleted-cafc456a-96ff-4e51-b0d5-9237991809c7 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:00:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2aca3d14-c101-4e96-ba55-308c6003d618 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "d4f0f927-23ad-4f92-acbb-cf6757f9c4e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.262s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:00:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:00:59 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Instance shutdown successfully.
Nov 08 22:01:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-unplugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] No waiting events found dispatching network-vif-unplugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:01:00 user nova-compute[75993]: WARNING nova.compute.manager [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received unexpected event network-vif-unplugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 for instance with vm_state active and task_state reboot_started.
Nov 08 22:01:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] No waiting events found dispatching network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:01:00 user nova-compute[75993]: WARNING nova.compute.manager [req-a8cf5480-3360-4d5a-a697-b5e28adcd2b6 req-a236c8ac-40d3-4e17-9d95-c8cece28501d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received unexpected event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 for instance with vm_state active and task_state reboot_started.
Nov 08 22:01:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] No waiting events found dispatching network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:01:02 user nova-compute[75993]: WARNING nova.compute.manager [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received unexpected event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 for instance with vm_state active and task_state reboot_started.
Nov 08 22:01:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] No waiting events found dispatching network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:01:02 user nova-compute[75993]: WARNING nova.compute.manager [req-f103cf33-efb6-44b0-a1d1-24465d5831cc req-8b4030fa-6852-444f-be7c-3ee827984730 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received unexpected event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 for instance with vm_state active and task_state reboot_started.
Nov 08 22:01:02 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Instance running successfully.
Nov 08 22:01:02 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Instance soft rebooted successfully.
Nov 08 22:01:02 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:01:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c044de0d-5f08-4518-aa60-3ce75d3505eb tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.845s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:07 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:01:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:01:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:01:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:01:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:01:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:01:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updating instance_info_cache with network_info: [{"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-64d8c15c-0ac9-434b-852a-123a940dc0ae" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:01:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:14 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:01:14 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:01:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=7907MB free_disk=24.763145446777344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:01:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d5fe6095-7bc6-48ae-b858-5ea2148ee423 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 4cf75975-1760-4697-8186-87ccee8ae77b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9ca82207-c9df-4e5f-9eae-459397b1a414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance b1fa9fef-15d1-457f-955d-887fc358d4a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 3713db24-c1c7-4755-b94f-ec88b1fbc960 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:01:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.403s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:16 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:01:16 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:01:16 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:01:16 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:01:16 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG nova.objects.instance [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lazy-loading 'pci_requests' on Instance uuid 3713db24-c1c7-4755-b94f-ec88b1fbc960 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG nova.objects.instance [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lazy-loading 'numa_topology' on Instance uuid 3713db24-c1c7-4755-b94f-ec88b1fbc960 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:01:18 user nova-compute[75993]: INFO nova.compute.claims [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Claim successful on node user
Nov 08 22:01:18 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XyJlbqmY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:01:18 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:01:18 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:01:18 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61d6bc5-782f-4d5f-a6ed-cfd38d065b96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:01:18 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5477cd0-94ce-4559-afce-e85cbdfeb16f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414] added
Nov 08 22:01:18 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[270c56a6-81e6-4c59-b55e-9da3f55cc2f7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[28af4a3c-6610-47fc-88b4-6db3afcff13b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XyJlbqmY {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XyJlbqmY" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ebf9ad-674d-4e40-9850-f31f5f2e8221]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XyJlbqmY'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a24693-1943-4a7f-9a62-fdce00865c24]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc1ef6c-a5f4-4977-9c28-005b3e5b00e8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5816f35-9f3a-449b-9aa1-1d4908d8785c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414, portal: 172.16.0.220,3260]
Nov 08 22:01:18 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414, portal: 172.16.0.220,3260] successful.
Nov 08 22:01:18 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce42fc3-99e3-4939-bf4b-4b2a64a69f0f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d91d6ef-7992-4b97-b5b6-72ed86b33ff7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)
Nov 08 22:01:18 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fcaf03-3fa1-4cfa-bf8c-8aaa6ba80112]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:01:18 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XyJlbqmY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:01:18 user nova-compute[75993]: INFO nova.network.neutron [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating port fe2d45f6-7eff-41c3-b47d-7f499f73bf33 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquired lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG nova.network.neutron [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-e19b5e7c-be54-4258-9a23-84fbee76b5e5 req-049aa148-0f5a-4c63-b451-32254d307964 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-changed-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-e19b5e7c-be54-4258-9a23-84fbee76b5e5 req-049aa148-0f5a-4c63-b451-32254d307964 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Refreshing instance network info cache due to event network-changed-fe2d45f6-7eff-41c3-b47d-7f499f73bf33. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e19b5e7c-be54-4258-9a23-84fbee76b5e5 req-049aa148-0f5a-4c63-b451-32254d307964 service nova] Acquiring lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26362613062353461', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362613062353461', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG nova.objects.instance [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:01:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 22:01:19 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:01:19 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:01:19 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:01:19 user nova-compute[75993]:   <serial>21482176-527a-427e-87a5-6cad41acc414</serial>
Nov 08 22:01:19 user nova-compute[75993]: </disk>
Nov 08 22:01:19 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating instance_info_cache with network_info: [{"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No VIF found with MAC fa:16:3e:bb:b1:a2, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Releasing lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:01:20 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Creating image(s)
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Ensure instance console log exists: /opt/stack/data/nova/instances/3713db24-c1c7-4755-b94f-ec88b1fbc960/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Start _get_guest_xml network_info=[{"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'd71d1d90-ef0a-472a-9293-f34de466e7e8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXNAgQDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3713db24-c1c7-4755-b94f-ec88b1fbc960', 'attached_at': '', 'detached_at': '', 'volume_id': '32658f8f-79d5-4fec-8cc0-db9c0142af76', 'serial': '32658f8f-79d5-4fec-8cc0-db9c0142af76'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e19b5e7c-be54-4258-9a23-84fbee76b5e5 req-049aa148-0f5a-4c63-b451-32254d307964 service nova] Acquired lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.network.neutron [req-e19b5e7c-be54-4258-9a23-84fbee76b5e5 req-049aa148-0f5a-4c63-b451-32254d307964 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Refreshing network info cache for port fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:01:20 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:01:20 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.objects.instance [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3713db24-c1c7-4755-b94f-ec88b1fbc960 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.objects.base [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Object Instance<3713db24-c1c7-4755-b94f-ec88b1fbc960> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXNAgQDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:01:20 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:01:20 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:01:20 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[52504e29-f270-4b63-94eb-d3d7187f5547]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:01:20 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-cc5cffd5-34d5-4aa4-92d1-ba77de7b9ed2 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.576s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 26.513s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea3a265-0ba3-4560-a7f0-55f171454af2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76] added
Nov 08 22:01:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0ee35d-aa15-4ff7-b088-91f196312905]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fafd795-756c-4f20-80cf-589ceda8b516]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXNAgQDb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FXNAgQDb" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9276c0e6-288e-456c-bfb0-8d5fa8a9b469]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FXNAgQDb'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2227e5b8-0fca-4edf-a62e-ab961351c7cf]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[87785d0a-1213-41cf-8149-5f901c2f36e1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecce606a-a96f-47ef-a142-44d9b9b15ec2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260]
Nov 08 22:01:20 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260] successful.
Nov 08 22:01:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d60e38-8f36-41d1-9e4b-e1e8ff88aec9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4b1595-5d70-4c0f-93a9-c816a2ac4cf7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:01:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.network.neutron [req-e19b5e7c-be54-4258-9a23-84fbee76b5e5 req-049aa148-0f5a-4c63-b451-32254d307964 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updated VIF entry in instance network info cache for port fe2d45f6-7eff-41c3-b47d-7f499f73bf33. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG nova.network.neutron [req-e19b5e7c-be54-4258-9a23-84fbee76b5e5 req-049aa148-0f5a-4c63-b451-32254d307964 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating instance_info_cache with network_info: [{"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e19b5e7c-be54-4258-9a23-84fbee76b5e5 req-049aa148-0f5a-4c63-b451-32254d307964 service nova] Releasing lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.160s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec592760-e1e5-4708-b69d-0d094cc2a834]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:01:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXNAgQDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] <== connect_volume: return (1492ms) {'type': 'block', 'scsi_wwn': '23733366535633866', 'path': '/dev/sdf'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733366535633866', 'path': '/dev/sdf'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T21:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1289890038',display_name='tempest-TestShelveInstance-server-1289890038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1289890038',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-243862016',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:57:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='482c9b5155b94bb1a5f1189ffc0c9cdc',ramdisk_id='',reservation_id='r-p0nylb07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-510215546',owner_user_name='tempest-TestShelveInstance-510215546-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:00:34Z,user_data=None,user_id='55e7e193334f4d83949bf4119b71661c',uuid=3713db24-c1c7-4755-b94f-ec88b1fbc960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converting VIF {"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.objects.instance [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lazy-loading 'pci_devices' on Instance uuid 3713db24-c1c7-4755-b94f-ec88b1fbc960 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.objects.base [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Object Instance<3713db24-c1c7-4755-b94f-ec88b1fbc960> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:01:21 user nova-compute[75993]:   <uuid>3713db24-c1c7-4755-b94f-ec88b1fbc960</uuid>
Nov 08 22:01:21 user nova-compute[75993]:   <name>instance-00000022</name>
Nov 08 22:01:21 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:01:21 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:01:21 user nova-compute[75993]:   <metadata>
Nov 08 22:01:21 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:01:21 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:01:21 user nova-compute[75993]:       <nova:name>tempest-TestShelveInstance-server-1289890038</nova:name>
Nov 08 22:01:21 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:01:20</nova:creationTime>
Nov 08 22:01:21 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:01:21 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:01:21 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:01:21 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:01:21 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:01:21 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:01:21 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:01:21 user nova-compute[75993]:       <nova:owner>
Nov 08 22:01:21 user nova-compute[75993]:         <nova:user uuid="55e7e193334f4d83949bf4119b71661c">tempest-TestShelveInstance-510215546-project-member</nova:user>
Nov 08 22:01:21 user nova-compute[75993]:         <nova:project uuid="482c9b5155b94bb1a5f1189ffc0c9cdc">tempest-TestShelveInstance-510215546</nova:project>
Nov 08 22:01:21 user nova-compute[75993]:       </nova:owner>
Nov 08 22:01:21 user nova-compute[75993]:       <nova:ports>
Nov 08 22:01:21 user nova-compute[75993]:         <nova:port uuid="fe2d45f6-7eff-41c3-b47d-7f499f73bf33">
Nov 08 22:01:21 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 22:01:21 user nova-compute[75993]:         </nova:port>
Nov 08 22:01:21 user nova-compute[75993]:       </nova:ports>
Nov 08 22:01:21 user nova-compute[75993]:     </nova:instance>
Nov 08 22:01:21 user nova-compute[75993]:   </metadata>
Nov 08 22:01:21 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:01:21 user nova-compute[75993]:     <system>
Nov 08 22:01:21 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:01:21 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:01:21 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:01:21 user nova-compute[75993]:       <entry name="serial">3713db24-c1c7-4755-b94f-ec88b1fbc960</entry>
Nov 08 22:01:21 user nova-compute[75993]:       <entry name="uuid">3713db24-c1c7-4755-b94f-ec88b1fbc960</entry>
Nov 08 22:01:21 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:01:21 user nova-compute[75993]:     </system>
Nov 08 22:01:21 user nova-compute[75993]:   </sysinfo>
Nov 08 22:01:21 user nova-compute[75993]:   <os>
Nov 08 22:01:21 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:01:21 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:01:21 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:01:21 user nova-compute[75993]:   </os>
Nov 08 22:01:21 user nova-compute[75993]:   <features>
Nov 08 22:01:21 user nova-compute[75993]:     <acpi/>
Nov 08 22:01:21 user nova-compute[75993]:     <apic/>
Nov 08 22:01:21 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:01:21 user nova-compute[75993]:   </features>
Nov 08 22:01:21 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:01:21 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:01:21 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:01:21 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:01:21 user nova-compute[75993]:   </clock>
Nov 08 22:01:21 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:01:21 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:01:21 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:01:21 user nova-compute[75993]:   </cpu>
Nov 08 22:01:21 user nova-compute[75993]:   <devices>
Nov 08 22:01:21 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 22:01:21 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:01:21 user nova-compute[75993]:       <source dev="/dev/sdf"/>
Nov 08 22:01:21 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:01:21 user nova-compute[75993]:       <serial>32658f8f-79d5-4fec-8cc0-db9c0142af76</serial>
Nov 08 22:01:21 user nova-compute[75993]:     </disk>
Nov 08 22:01:21 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:01:21 user nova-compute[75993]:       <mac address="fa:16:3e:c5:06:b5"/>
Nov 08 22:01:21 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:01:21 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:01:21 user nova-compute[75993]:       <target dev="tapfe2d45f6-7e"/>
Nov 08 22:01:21 user nova-compute[75993]:     </interface>
Nov 08 22:01:21 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:01:21 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/3713db24-c1c7-4755-b94f-ec88b1fbc960/console.log" append="off"/>
Nov 08 22:01:21 user nova-compute[75993]:     </serial>
Nov 08 22:01:21 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:01:21 user nova-compute[75993]:     <video>
Nov 08 22:01:21 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:01:21 user nova-compute[75993]:     </video>
Nov 08 22:01:21 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:01:21 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:01:21 user nova-compute[75993]:     </rng>
Nov 08 22:01:21 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:01:21 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:01:21 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:01:21 user nova-compute[75993]:     </memballoon>
Nov 08 22:01:21 user nova-compute[75993]:   </devices>
Nov 08 22:01:21 user nova-compute[75993]: </domain>
Nov 08 22:01:21 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T21:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1289890038',display_name='tempest-TestShelveInstance-server-1289890038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1289890038',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-243862016',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:57:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='482c9b5155b94bb1a5f1189ffc0c9cdc',ramdisk_id='',reservation_id='r-p0nylb07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-510215546',owner_user_name='tempest-TestShelveInstance-510215546-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:00:34Z,user_data=None,user_id='55e7e193334f4d83949bf4119b71661c',uuid=3713db24-c1c7-4755-b94f-ec88b1fbc960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converting VIF {"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG os_vif [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9db3ac7c-bbc4-5eb5-aac4-ef32c94720e7', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe2d45f6-7e, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe2d45f6-7e, col_values=(('qos', UUID('e9b6541e-56ec-473b-befe-637d7e0d9c80')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe2d45f6-7e, col_values=(('external_ids', {'iface-id': 'fe2d45f6-7eff-41c3-b47d-7f499f73bf33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:06:b5', 'vm-uuid': '3713db24-c1c7-4755-b94f-ec88b1fbc960'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:21 user nova-compute[75993]: INFO os_vif [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e')
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:01:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] No VIF found with MAC fa:16:3e:c5:06:b5, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:01:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-dab3fafb-c3ee-40a7-a306-b3ad86e3a492 req-9832f542-ea0c-45b7-aa4f-770b8cab20fe service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dab3fafb-c3ee-40a7-a306-b3ad86e3a492 req-9832f542-ea0c-45b7-aa4f-770b8cab20fe service nova] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dab3fafb-c3ee-40a7-a306-b3ad86e3a492 req-9832f542-ea0c-45b7-aa4f-770b8cab20fe service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dab3fafb-c3ee-40a7-a306-b3ad86e3a492 req-9832f542-ea0c-45b7-aa4f-770b8cab20fe service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:23 user nova-compute[75993]: DEBUG nova.compute.manager [req-dab3fafb-c3ee-40a7-a306-b3ad86e3a492 req-9832f542-ea0c-45b7-aa4f-770b8cab20fe service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] No waiting events found dispatching network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:01:23 user nova-compute[75993]: WARNING nova.compute.manager [req-dab3fafb-c3ee-40a7-a306-b3ad86e3a492 req-9832f542-ea0c-45b7-aa4f-770b8cab20fe service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received unexpected event network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 22:01:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:24 user nova-compute[75993]: INFO nova.compute.manager [None req-c9ee21c4-2a0b-4b18-8d05-e04dd1e016b4 tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Get console output
Nov 08 22:01:24 user nova-compute[75993]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 08 22:01:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:01:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:01:25 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Instance spawned successfully.
Nov 08 22:01:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:01:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10edbe6c-a3b6-42b1-92e8-faa6985c204d tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 51.929s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-495ca02d-abe4-4230-8d08-62460863c6e2 req-eaa9878b-99de-402d-ab9e-732b2dda4927 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-495ca02d-abe4-4230-8d08-62460863c6e2 req-eaa9878b-99de-402d-ab9e-732b2dda4927 service nova] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-495ca02d-abe4-4230-8d08-62460863c6e2 req-eaa9878b-99de-402d-ab9e-732b2dda4927 service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-495ca02d-abe4-4230-8d08-62460863c6e2 req-eaa9878b-99de-402d-ab9e-732b2dda4927 service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-495ca02d-abe4-4230-8d08-62460863c6e2 req-eaa9878b-99de-402d-ab9e-732b2dda4927 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] No waiting events found dispatching network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:01:25 user nova-compute[75993]: WARNING nova.compute.manager [req-495ca02d-abe4-4230-8d08-62460863c6e2 req-eaa9878b-99de-402d-ab9e-732b2dda4927 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received unexpected event network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 for instance with vm_state active and task_state None.
Nov 08 22:01:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Acquiring lock "b1fa9fef-15d1-457f-955d-887fc358d4a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Acquiring lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:32 user nova-compute[75993]: INFO nova.compute.manager [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Terminating instance
Nov 08 22:01:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-ef6242d6-766f-4d98-a5e2-64d890d358b0 req-522e3702-665d-458f-b7d2-9d744744c69d service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Received event network-vif-unplugged-226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ef6242d6-766f-4d98-a5e2-64d890d358b0 req-522e3702-665d-458f-b7d2-9d744744c69d service nova] Acquiring lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ef6242d6-766f-4d98-a5e2-64d890d358b0 req-522e3702-665d-458f-b7d2-9d744744c69d service nova] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ef6242d6-766f-4d98-a5e2-64d890d358b0 req-522e3702-665d-458f-b7d2-9d744744c69d service nova] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-ef6242d6-766f-4d98-a5e2-64d890d358b0 req-522e3702-665d-458f-b7d2-9d744744c69d service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] No waiting events found dispatching network-vif-unplugged-226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-ef6242d6-766f-4d98-a5e2-64d890d358b0 req-522e3702-665d-458f-b7d2-9d744744c69d service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Received event network-vif-unplugged-226fccc2-0a16-4ece-9718-c56e1bad8358 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:01:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Instance destroyed successfully.
Nov 08 22:01:32 user nova-compute[75993]: DEBUG nova.objects.instance [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lazy-loading 'resources' on Instance uuid b1fa9fef-15d1-457f-955d-887fc358d4a3 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:59:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1301524366',display_name='tempest-VolumesNegativeTest-instance-1301524366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1301524366',id=37,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:59:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d85d2b73579643af9f4b9720cb4c2ac6',ramdisk_id='',reservation_id='r-w1rhc2u1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1103490924',owner_user_name='tempest-VolumesNegativeTest-1103490924-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:59:48Z,user_data=None,user_id='654d309e17344aaab4dab13efdee85d1',uuid=b1fa9fef-15d1-457f-955d-887fc358d4a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "226fccc2-0a16-4ece-9718-c56e1bad8358", "address": "fa:16:3e:d1:b8:90", "network": {"id": "b8483ba3-7547-4fef-9fb5-e13da22289eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "595af569c4ed47aa9b06f30e79e17e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226fccc2-0a", "ovs_interfaceid": "226fccc2-0a16-4ece-9718-c56e1bad8358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Converting VIF {"id": "226fccc2-0a16-4ece-9718-c56e1bad8358", "address": "fa:16:3e:d1:b8:90", "network": {"id": "b8483ba3-7547-4fef-9fb5-e13da22289eb", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "595af569c4ed47aa9b06f30e79e17e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap226fccc2-0a", "ovs_interfaceid": "226fccc2-0a16-4ece-9718-c56e1bad8358", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=226fccc2-0a16-4ece-9718-c56e1bad8358,network=Network(b8483ba3-7547-4fef-9fb5-e13da22289eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226fccc2-0a') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG os_vif [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=226fccc2-0a16-4ece-9718-c56e1bad8358,network=Network(b8483ba3-7547-4fef-9fb5-e13da22289eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226fccc2-0a') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap226fccc2-0a, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fdfa050-f3bf-4bd0-b1ac-69f48d3f9656) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:32 user nova-compute[75993]: INFO os_vif [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:b8:90,bridge_name='br-int',has_traffic_filtering=True,id=226fccc2-0a16-4ece-9718-c56e1bad8358,network=Network(b8483ba3-7547-4fef-9fb5-e13da22289eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap226fccc2-0a')
Nov 08 22:01:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Deleting instance files /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3_del
Nov 08 22:01:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Deletion of /opt/stack/data/nova/instances/b1fa9fef-15d1-457f-955d-887fc358d4a3_del complete
Nov 08 22:01:32 user nova-compute[75993]: INFO nova.compute.manager [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 22:01:32 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:01:32 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:01:33 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:01:33 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Took 0.51 seconds to deallocate network for instance.
Nov 08 22:01:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:33 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:01:33 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:01:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:33 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Deleted allocations for instance b1fa9fef-15d1-457f-955d-887fc358d4a3
Nov 08 22:01:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-39722f8b-57ee-4472-ad99-39e63c07a872 tempest-VolumesNegativeTest-1103490924 tempest-VolumesNegativeTest-1103490924-project-member] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.936s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-cc645eb8-006f-46dc-bc55-ba31ccd3c0d2 req-3d4dcfd1-6986-4bf1-88e5-c306dbb84f5a service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Received event network-vif-plugged-226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cc645eb8-006f-46dc-bc55-ba31ccd3c0d2 req-3d4dcfd1-6986-4bf1-88e5-c306dbb84f5a service nova] Acquiring lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cc645eb8-006f-46dc-bc55-ba31ccd3c0d2 req-3d4dcfd1-6986-4bf1-88e5-c306dbb84f5a service nova] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cc645eb8-006f-46dc-bc55-ba31ccd3c0d2 req-3d4dcfd1-6986-4bf1-88e5-c306dbb84f5a service nova] Lock "b1fa9fef-15d1-457f-955d-887fc358d4a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-cc645eb8-006f-46dc-bc55-ba31ccd3c0d2 req-3d4dcfd1-6986-4bf1-88e5-c306dbb84f5a service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] No waiting events found dispatching network-vif-plugged-226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:01:34 user nova-compute[75993]: WARNING nova.compute.manager [req-cc645eb8-006f-46dc-bc55-ba31ccd3c0d2 req-3d4dcfd1-6986-4bf1-88e5-c306dbb84f5a service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Received unexpected event network-vif-plugged-226fccc2-0a16-4ece-9718-c56e1bad8358 for instance with vm_state deleted and task_state None.
Nov 08 22:01:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-cc645eb8-006f-46dc-bc55-ba31ccd3c0d2 req-3d4dcfd1-6986-4bf1-88e5-c306dbb84f5a service nova] [instance: b1fa9fef-15d1-457f-955d-887fc358d4a3] Received event network-vif-deleted-226fccc2-0a16-4ece-9718-c56e1bad8358 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:46 user nova-compute[75993]: INFO nova.compute.manager [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Terminating instance
Nov 08 22:01:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-9990454e-849b-41df-9d58-c6e4ca67e76e req-583cea9e-bfe3-43ac-a731-ac3ca1ce0349 service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Received event network-vif-unplugged-74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9990454e-849b-41df-9d58-c6e4ca67e76e req-583cea9e-bfe3-43ac-a731-ac3ca1ce0349 service nova] Acquiring lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9990454e-849b-41df-9d58-c6e4ca67e76e req-583cea9e-bfe3-43ac-a731-ac3ca1ce0349 service nova] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9990454e-849b-41df-9d58-c6e4ca67e76e req-583cea9e-bfe3-43ac-a731-ac3ca1ce0349 service nova] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-9990454e-849b-41df-9d58-c6e4ca67e76e req-583cea9e-bfe3-43ac-a731-ac3ca1ce0349 service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] No waiting events found dispatching network-vif-unplugged-74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:01:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-9990454e-849b-41df-9d58-c6e4ca67e76e req-583cea9e-bfe3-43ac-a731-ac3ca1ce0349 service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Received event network-vif-unplugged-74dd16d2-b674-4372-a9a0-88b46af2c028 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:01:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Instance destroyed successfully.
Nov 08 22:01:47 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'resources' on Instance uuid 95f8efd2-7c61-49b3-9e7d-ec97a4d22615 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:51:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-154014429',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-154014429',id=31,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:51:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-p8oun400',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:53:30Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=95f8efd2-7c61-49b3-9e7d-ec97a4d22615,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74dd16d2-b674-4372-a9a0-88b46af2c028", "address": "fa:16:3e:f2:19:50", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74dd16d2-b6", "ovs_interfaceid": "74dd16d2-b674-4372-a9a0-88b46af2c028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "74dd16d2-b674-4372-a9a0-88b46af2c028", "address": "fa:16:3e:f2:19:50", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74dd16d2-b6", "ovs_interfaceid": "74dd16d2-b674-4372-a9a0-88b46af2c028", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:19:50,bridge_name='br-int',has_traffic_filtering=True,id=74dd16d2-b674-4372-a9a0-88b46af2c028,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74dd16d2-b6') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG os_vif [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:19:50,bridge_name='br-int',has_traffic_filtering=True,id=74dd16d2-b674-4372-a9a0-88b46af2c028,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74dd16d2-b6') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74dd16d2-b6, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b61d3d2-6e2f-42b3-a2b4-eb6c9218e72c) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:47 user nova-compute[75993]: INFO os_vif [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:19:50,bridge_name='br-int',has_traffic_filtering=True,id=74dd16d2-b674-4372-a9a0-88b46af2c028,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74dd16d2-b6')
Nov 08 22:01:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Deleting instance files /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615_del
Nov 08 22:01:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Deletion of /opt/stack/data/nova/instances/95f8efd2-7c61-49b3-9e7d-ec97a4d22615_del complete
Nov 08 22:01:47 user nova-compute[75993]: INFO nova.compute.manager [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 08 22:01:47 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:01:47 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Took 0.53 seconds to deallocate network for instance.
Nov 08 22:01:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-48c7bb1c-e965-4897-ad7d-cd489c425f66 req-fe9fbe59-559f-4e54-8425-e2cc1840dcaf service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Received event network-vif-deleted-74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:48 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:01:48 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:01:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:48 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Deleted allocations for instance 95f8efd2-7c61-49b3-9e7d-ec97a4d22615
Nov 08 22:01:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a1b2f83e-7cb0-46aa-bce2-7f15333d8101 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-349c2859-c23c-43b0-b10c-7940c51a12ac req-f904dd7e-c7be-43a3-80fe-54479998f412 service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Received event network-vif-plugged-74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:01:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-349c2859-c23c-43b0-b10c-7940c51a12ac req-f904dd7e-c7be-43a3-80fe-54479998f412 service nova] Acquiring lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-349c2859-c23c-43b0-b10c-7940c51a12ac req-f904dd7e-c7be-43a3-80fe-54479998f412 service nova] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-349c2859-c23c-43b0-b10c-7940c51a12ac req-f904dd7e-c7be-43a3-80fe-54479998f412 service nova] Lock "95f8efd2-7c61-49b3-9e7d-ec97a4d22615-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:01:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-349c2859-c23c-43b0-b10c-7940c51a12ac req-f904dd7e-c7be-43a3-80fe-54479998f412 service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] No waiting events found dispatching network-vif-plugged-74dd16d2-b674-4372-a9a0-88b46af2c028 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:01:48 user nova-compute[75993]: WARNING nova.compute.manager [req-349c2859-c23c-43b0-b10c-7940c51a12ac req-f904dd7e-c7be-43a3-80fe-54479998f412 service nova] [instance: 95f8efd2-7c61-49b3-9e7d-ec97a4d22615] Received unexpected event network-vif-plugged-74dd16d2-b674-4372-a9a0-88b46af2c028 for instance with vm_state deleted and task_state None.
Nov 08 22:01:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:01:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:01:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:01:59 user nova-compute[75993]: INFO nova.compute.manager [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Detaching volume 21482176-527a-427e-87a5-6cad41acc414
Nov 08 22:01:59 user nova-compute[75993]: INFO nova.virt.block_device [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attempting to driver detach volume 21482176-527a-427e-87a5-6cad41acc414 from mountpoint /dev/vdb
Nov 08 22:01:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Attempting to detach device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 22:01:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:01:59 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:01:59 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:01:59 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:01:59 user nova-compute[75993]:   <serial>21482176-527a-427e-87a5-6cad41acc414</serial>
Nov 08 22:01:59 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:01:59 user nova-compute[75993]: </disk>
Nov 08 22:01:59 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:01:59 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Successfully detached device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the persistent domain config.
Nov 08 22:01:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 22:01:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:01:59 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:01:59 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:01:59 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:01:59 user nova-compute[75993]:   <serial>21482176-527a-427e-87a5-6cad41acc414</serial>
Nov 08 22:01:59 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:01:59 user nova-compute[75993]: </disk>
Nov 08 22:01:59 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:02:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 22:02:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:02:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:08 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:02:11 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:02:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:11 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:02:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:02:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:02:13 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:02:13 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8105MB free_disk=24.913524627685547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 64d8c15c-0ac9-434b-852a-123a940dc0ae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance d5fe6095-7bc6-48ae-b858-5ea2148ee423 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 4cf75975-1760-4697-8186-87ccee8ae77b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9ca82207-c9df-4e5f-9eae-459397b1a414 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 3713db24-c1c7-4755-b94f-ec88b1fbc960 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:02:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:14 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:02:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:02:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:02:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:02:15 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:02:15 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating instance_info_cache with network_info: [{"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:02:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-d5fe6095-7bc6-48ae-b858-5ea2148ee423" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:02:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:02:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:02:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:02:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:02:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:02:18 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:02:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:02:20 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 is timed out.
Nov 08 22:02:20 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Successfully detached device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the live domain config.
Nov 08 22:02:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XyJlbqmY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:02:20 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a46efc9-26b8-4917-93b2-8d81e3690d21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:02:20 user nova-compute[75993]: No targets found.
Nov 08 22:02:20 user nova-compute[75993]: iSNS:
Nov 08 22:02:20 user nova-compute[75993]: No targets found.
Nov 08 22:02:20 user nova-compute[75993]: STATIC:
Nov 08 22:02:20 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76
Nov 08 22:02:20 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:20 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:20 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 22:02:20 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:20 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:20 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9
Nov 08 22:02:20 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:20 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:20 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4
Nov 08 22:02:20 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:20 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:20 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414
Nov 08 22:02:20 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:20 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:20 user nova-compute[75993]: FIRMWARE:
Nov 08 22:02:20 user nova-compute[75993]: No targets found.
Nov 08 22:02:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:02:20 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:02:20 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bc79ae-5562-4144-b7da-c7ed614006be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[623dea66-e7ff-4975-835f-2463ebbe4adb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:02:20 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:02:20 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:02:20 user nova-compute[75993]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)
Nov 08 22:02:20 user nova-compute[75993]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:02:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:02:20 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:02:20 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:02:20 user nova-compute[75993]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 (non-flash)
Nov 08 22:02:20 user nova-compute[75993]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:02:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544ea56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36b709f-326d-438a-82de-13a78d5e968e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[415998c3-80fc-4a58-a42a-617bdb65f343]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d4628b-d084-4883-a2d6-0b648637d01b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad8d9d7-1b92-4501-8220-382103eb5cb7]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0b6055-7912-4987-9fab-c5de0458b8b6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d87220-275a-4184-9e38-c11c6f0af24e]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414, portal: 172.16.0.220,3260]
Nov 08 22:02:20 user nova-compute[75993]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414, portal: 172.16.0.220,3260] successful.
Nov 08 22:02:20 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21482176-527a-427e-87a5-6cad41acc414 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d078666-5a98-4f18-8cf8-7d98905692b6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== disconnect_volume: return (312ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:02:20 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:02:21 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:02:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e04f81d2-20a3-445b-ac80-948f309877ba tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.770s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:02:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:02:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:24 user nova-compute[75993]: INFO nova.compute.manager [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Terminating instance
Nov 08 22:02:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:02:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-549c82df-9fe1-49bf-b116-e885fb89954b req-a6aedb7c-eefe-4153-ae54-86486f5f7466 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-vif-unplugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-549c82df-9fe1-49bf-b116-e885fb89954b req-a6aedb7c-eefe-4153-ae54-86486f5f7466 service nova] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-549c82df-9fe1-49bf-b116-e885fb89954b req-a6aedb7c-eefe-4153-ae54-86486f5f7466 service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-549c82df-9fe1-49bf-b116-e885fb89954b req-a6aedb7c-eefe-4153-ae54-86486f5f7466 service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-549c82df-9fe1-49bf-b116-e885fb89954b req-a6aedb7c-eefe-4153-ae54-86486f5f7466 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] No waiting events found dispatching network-vif-unplugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-549c82df-9fe1-49bf-b116-e885fb89954b req-a6aedb7c-eefe-4153-ae54-86486f5f7466 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-vif-unplugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:25 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Instance destroyed successfully.
Nov 08 22:02:25 user nova-compute[75993]: DEBUG nova.objects.instance [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'resources' on Instance uuid d5fe6095-7bc6-48ae-b858-5ea2148ee423 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:55:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1836352422',display_name='tempest-ServerActionsTestOtherA-server-1836352422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1836352422',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIbQxx7DuVFUAXtivYRWFOk6i/ACW0OwEKdIgB2j1c2VjAAObwQ9qWcNKT6+OGS47GK/q93vubsJMppLLdAeY5qiAyBaCE0GMrdNogpncAZOwVmmfngYFO0ELy5AfYiWQ==',key_name='tempest-keypair-1988537750',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:58:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-ep0z5zdk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:59:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=d5fe6095-7bc6-48ae-b858-5ea2148ee423,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "address": "fa:16:3e:6c:a3:fa", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap817baf15-2d", "ovs_interfaceid": "817baf15-2d4e-4d79-ab15-e70b6317cf5a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_vif [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap817baf15-2d, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ef04c3c-5ab8-417a-8590-239f33be48a8) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:02:25 user nova-compute[75993]: INFO os_vif [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:a3:fa,bridge_name='br-int',has_traffic_filtering=True,id=817baf15-2d4e-4d79-ab15-e70b6317cf5a,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap817baf15-2d')
Nov 08 22:02:25 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTeEifgZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:02:25 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3895325b-0e8d-4a4a-b47a-36f3ad31e8b8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:02:25 user nova-compute[75993]: No targets found.
Nov 08 22:02:25 user nova-compute[75993]: iSNS:
Nov 08 22:02:25 user nova-compute[75993]: No targets found.
Nov 08 22:02:25 user nova-compute[75993]: STATIC:
Nov 08 22:02:25 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76
Nov 08 22:02:25 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:25 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:25 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 22:02:25 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:25 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:25 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9
Nov 08 22:02:25 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:25 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:25 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4
Nov 08 22:02:25 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:25 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:25 user nova-compute[75993]: FIRMWARE:
Nov 08 22:02:25 user nova-compute[75993]: No targets found.
Nov 08 22:02:25 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:02:25 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:02:25 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6ddebf-de8b-428f-a1e5-a0ebe05dc56d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[972a938f-1e45-4ce6-9f5b-39040fb3a1a9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:02:25 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:02:25 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:02:25 user nova-compute[75993]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:02:25 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:02:25 user nova-compute[75993]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 (non-flash)
Nov 08 22:02:25 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:02:25 user nova-compute[75993]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:02:25 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544d63250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4'): ({'sde'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Removing single pathed devices sde {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db690b0-bbaf-4fa1-8e8a-dd5ac0df91d4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[156ac58a-f441-4c82-8f78-6496ce7afe3d]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Flushing IO for device /dev/sde {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a864411f-b004-461b-9e24-0d74a1a116ee]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c094b392-6194-4203-b24c-c49e4be91a0d]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] SCSI volumes sde have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f6a10404', '/dev/disk/by-id/scsi-1SCST_BIOf6a10404-26b1bb3d582590e4') {{(pid=86999) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 22:02:25 user nova-compute[75993]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_f6a10404
Nov 08 22:02:25 user nova-compute[75993]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOf6a10404-26b1bb3d582590e4
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e68c1a0-3e5b-4dc1-99d6-b0e9c1694ccd]: (4, None) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[256feeed-8fc1-459d-a218-799fd99415f9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:02:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1c3716-e6f6-44cc-9de6-68008a0bb809]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260]
Nov 08 22:02:26 user nova-compute[75993]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4, portal: 172.16.0.220,3260] successful.
Nov 08 22:02:26 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d066025e-5c4a-478d-b7c8-4b70449486e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc12d1a-affd-4e8a-8b3b-408abab31778]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] <== disconnect_volume: return (349ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:02:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Deleting instance files /opt/stack/data/nova/instances/d5fe6095-7bc6-48ae-b858-5ea2148ee423_del
Nov 08 22:02:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Deletion of /opt/stack/data/nova/instances/d5fe6095-7bc6-48ae-b858-5ea2148ee423_del complete
Nov 08 22:02:26 user nova-compute[75993]: INFO nova.compute.manager [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 08 22:02:26 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:02:26 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Took 0.80 seconds to deallocate network for instance.
Nov 08 22:02:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-6e21807d-b3db-49bf-ac76-6fea20278728 req-f1edaadd-809a-4f83-bef2-128b5757c919 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-vif-deleted-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:02:26 user nova-compute[75993]: INFO nova.compute.manager [req-6e21807d-b3db-49bf-ac76-6fea20278728 req-f1edaadd-809a-4f83-bef2-128b5757c919 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Neutron deleted interface 817baf15-2d4e-4d79-ab15-e70b6317cf5a; detaching it from the instance and deleting it from the info cache
Nov 08 22:02:26 user nova-compute[75993]: DEBUG nova.network.neutron [req-6e21807d-b3db-49bf-ac76-6fea20278728 req-f1edaadd-809a-4f83-bef2-128b5757c919 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:02:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-6e21807d-b3db-49bf-ac76-6fea20278728 req-f1edaadd-809a-4f83-bef2-128b5757c919 service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Detach interface failed, port_id=817baf15-2d4e-4d79-ab15-e70b6317cf5a, reason: Instance d5fe6095-7bc6-48ae-b858-5ea2148ee423 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 22:02:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-f943f4a3-d409-4c66-ab07-0910e347b715 req-3e6e4012-8af7-4a5a-b82c-d409038db58d service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:02:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f943f4a3-d409-4c66-ab07-0910e347b715 req-3e6e4012-8af7-4a5a-b82c-d409038db58d service nova] Acquiring lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f943f4a3-d409-4c66-ab07-0910e347b715 req-3e6e4012-8af7-4a5a-b82c-d409038db58d service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f943f4a3-d409-4c66-ab07-0910e347b715 req-3e6e4012-8af7-4a5a-b82c-d409038db58d service nova] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-f943f4a3-d409-4c66-ab07-0910e347b715 req-3e6e4012-8af7-4a5a-b82c-d409038db58d service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] No waiting events found dispatching network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:02:27 user nova-compute[75993]: WARNING nova.compute.manager [req-f943f4a3-d409-4c66-ab07-0910e347b715 req-3e6e4012-8af7-4a5a-b82c-d409038db58d service nova] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Received unexpected event network-vif-plugged-817baf15-2d4e-4d79-ab15-e70b6317cf5a for instance with vm_state active and task_state deleting.
Nov 08 22:02:27 user nova-compute[75993]: INFO nova.compute.manager [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Took 0.92 seconds to detach 1 volumes for instance.
Nov 08 22:02:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: d5fe6095-7bc6-48ae-b858-5ea2148ee423] Deleting volume: d066025e-5c4a-478d-b7c8-4b70449486e4 {{(pid=75993) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 22:02:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:28 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:02:28 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:02:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:28 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Deleted allocations for instance d5fe6095-7bc6-48ae-b858-5ea2148ee423
Nov 08 22:02:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-6b71426e-9a66-492c-a784-55df7e31f26a tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "d5fe6095-7bc6-48ae-b858-5ea2148ee423" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.385s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:02:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:36 user nova-compute[75993]: INFO nova.compute.manager [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Terminating instance
Nov 08 22:02:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:02:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-e310e51e-86b2-4413-9c78-66da358b16c1 req-e25f6b2d-ea6e-4854-a2ac-6030e4c1e53b service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-unplugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e310e51e-86b2-4413-9c78-66da358b16c1 req-e25f6b2d-ea6e-4854-a2ac-6030e4c1e53b service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e310e51e-86b2-4413-9c78-66da358b16c1 req-e25f6b2d-ea6e-4854-a2ac-6030e4c1e53b service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e310e51e-86b2-4413-9c78-66da358b16c1 req-e25f6b2d-ea6e-4854-a2ac-6030e4c1e53b service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-e310e51e-86b2-4413-9c78-66da358b16c1 req-e25f6b2d-ea6e-4854-a2ac-6030e4c1e53b service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-unplugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-e310e51e-86b2-4413-9c78-66da358b16c1 req-e25f6b2d-ea6e-4854-a2ac-6030e4c1e53b service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-unplugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:37 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Instance destroyed successfully.
Nov 08 22:02:37 user nova-compute[75993]: DEBUG nova.objects.instance [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'resources' on Instance uuid 64d8c15c-0ac9-434b-852a-123a940dc0ae {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:45:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1354744541',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1354744541',id=25,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:47:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-ekc9sy6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:49:45Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=64d8c15c-0ac9-434b-852a-123a940dc0ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "address": "fa:16:3e:5e:6e:60", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e1733d1-86", "ovs_interfaceid": "6e1733d1-86b8-4b78-b2a1-830ac109f583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:6e:60,bridge_name='br-int',has_traffic_filtering=True,id=6e1733d1-86b8-4b78-b2a1-830ac109f583,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e1733d1-86') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_vif [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:6e:60,bridge_name='br-int',has_traffic_filtering=True,id=6e1733d1-86b8-4b78-b2a1-830ac109f583,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e1733d1-86') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e1733d1-86, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5fba2e50-cbb7-42eb-9339-da45e59637f5) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:37 user nova-compute[75993]: INFO os_vif [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:6e:60,bridge_name='br-int',has_traffic_filtering=True,id=6e1733d1-86b8-4b78-b2a1-830ac109f583,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e1733d1-86')
Nov 08 22:02:37 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TLxGMFWg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:02:37 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd77ecff-d7cd-4315-beb9-6402ae0f72de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:02:37 user nova-compute[75993]: No targets found.
Nov 08 22:02:37 user nova-compute[75993]: iSNS:
Nov 08 22:02:37 user nova-compute[75993]: No targets found.
Nov 08 22:02:37 user nova-compute[75993]: STATIC:
Nov 08 22:02:37 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76
Nov 08 22:02:37 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:37 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:37 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3
Nov 08 22:02:37 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:37 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:37 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9
Nov 08 22:02:37 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:02:37 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:02:37 user nova-compute[75993]: FIRMWARE:
Nov 08 22:02:37 user nova-compute[75993]: No targets found.
Nov 08 22:02:37 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:02:37 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:02:37 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0418c4ae-be1b-432b-98c6-e003b23629ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2c235b-d0b9-4cbc-975b-8d5ff4706c78]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:02:37 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:02:37 user nova-compute[75993]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:02:37 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 (non-flash)
Nov 08 22:02:37 user nova-compute[75993]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:02:37 user nova-compute[75993]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:02:37 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544d1cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3'): ({'sdd'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Removing single pathed devices sdd {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5b3666-0dd9-4fef-b196-cc5e8fa748b9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c033872-d3b7-4262-90b4-f1f6915263fb]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Flushing IO for device /dev/sdd {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ed6f8-7287-4317-a78f-ac31194b21af]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55c980d-e88c-4e11-9f7f-f46defea736f]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] SCSI volumes sdd have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a277a8ff-97ad-4dcc-aa6d-a4ac962d4000]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c836fda-daa9-4e1e-b948-9d9b77bbd1e5]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3, portal: 172.16.0.220,3260]
Nov 08 22:02:37 user nova-compute[75993]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3, portal: 172.16.0.220,3260] successful.
Nov 08 22:02:37 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:02:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567f6f9e-3314-4f87-853f-7786f54a9ab3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:38 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bda8f5-6111-49d3-8621-6487e628db69]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:02:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:02:38 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] <== disconnect_volume: return (315ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:02:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:02:38 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Deleting instance files /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae_del
Nov 08 22:02:38 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Deletion of /opt/stack/data/nova/instances/64d8c15c-0ac9-434b-852a-123a940dc0ae_del complete
Nov 08 22:02:38 user nova-compute[75993]: INFO nova.compute.manager [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 08 22:02:38 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:02:38 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:02:38 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:02:38 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:02:38 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Took 0.77 seconds to deallocate network for instance.
Nov 08 22:02:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-320216a9-1a79-4fe5-918a-f4d164ea526a req-8d7d95fa-c13c-4e49-878a-32ae1bb4428a service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-deleted-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:02:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-27c217ba-1140-415e-9ae8-591fb87dc1f3 req-4de94bb8-0dc6-4ef3-9533-d4468871e8f7 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:02:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-27c217ba-1140-415e-9ae8-591fb87dc1f3 req-4de94bb8-0dc6-4ef3-9533-d4468871e8f7 service nova] Acquiring lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-27c217ba-1140-415e-9ae8-591fb87dc1f3 req-4de94bb8-0dc6-4ef3-9533-d4468871e8f7 service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-27c217ba-1140-415e-9ae8-591fb87dc1f3 req-4de94bb8-0dc6-4ef3-9533-d4468871e8f7 service nova] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-27c217ba-1140-415e-9ae8-591fb87dc1f3 req-4de94bb8-0dc6-4ef3-9533-d4468871e8f7 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] No waiting events found dispatching network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:02:39 user nova-compute[75993]: WARNING nova.compute.manager [req-27c217ba-1140-415e-9ae8-591fb87dc1f3 req-4de94bb8-0dc6-4ef3-9533-d4468871e8f7 service nova] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Received unexpected event network-vif-plugged-6e1733d1-86b8-4b78-b2a1-830ac109f583 for instance with vm_state active and task_state deleting.
Nov 08 22:02:39 user nova-compute[75993]: INFO nova.compute.manager [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 64d8c15c-0ac9-434b-852a-123a940dc0ae] Took 0.88 seconds to detach 1 volumes for instance.
Nov 08 22:02:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:40 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:02:40 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:02:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:40 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Deleted allocations for instance 64d8c15c-0ac9-434b-852a-123a940dc0ae
Nov 08 22:02:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2309dea2-44e2-4412-923a-f9088192ff27 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "64d8c15c-0ac9-434b-852a-123a940dc0ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.328s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-7751d592-1f9e-481e-a5e1-f02bb4cb8836 req-b0ac7a3b-6e39-4aa4-9959-20ff547d8420 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-changed-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:02:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-7751d592-1f9e-481e-a5e1-f02bb4cb8836 req-b0ac7a3b-6e39-4aa4-9959-20ff547d8420 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Refreshing instance network info cache due to event network-changed-95040a92-cb5d-43b2-9a5a-c54f134f28f6. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:02:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7751d592-1f9e-481e-a5e1-f02bb4cb8836 req-b0ac7a3b-6e39-4aa4-9959-20ff547d8420 service nova] Acquiring lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:02:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7751d592-1f9e-481e-a5e1-f02bb4cb8836 req-b0ac7a3b-6e39-4aa4-9959-20ff547d8420 service nova] Acquired lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:02:47 user nova-compute[75993]: DEBUG nova.network.neutron [req-7751d592-1f9e-481e-a5e1-f02bb4cb8836 req-b0ac7a3b-6e39-4aa4-9959-20ff547d8420 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Refreshing network info cache for port 95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:02:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:48 user nova-compute[75993]: DEBUG nova.network.neutron [req-7751d592-1f9e-481e-a5e1-f02bb4cb8836 req-b0ac7a3b-6e39-4aa4-9959-20ff547d8420 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updated VIF entry in instance network info cache for port 95040a92-cb5d-43b2-9a5a-c54f134f28f6. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:02:48 user nova-compute[75993]: DEBUG nova.network.neutron [req-7751d592-1f9e-481e-a5e1-f02bb4cb8836 req-b0ac7a3b-6e39-4aa4-9959-20ff547d8420 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updating instance_info_cache with network_info: [{"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:02:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7751d592-1f9e-481e-a5e1-f02bb4cb8836 req-b0ac7a3b-6e39-4aa4-9959-20ff547d8420 service nova] Releasing lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:02:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:48 user nova-compute[75993]: INFO nova.compute.manager [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Detaching volume beeaee07-ffb5-481f-9efb-485ae23da7f9
Nov 08 22:02:48 user nova-compute[75993]: INFO nova.virt.block_device [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Attempting to driver detach volume beeaee07-ffb5-481f-9efb-485ae23da7f9 from mountpoint /dev/vdb
Nov 08 22:02:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Attempting to detach device vdb from instance 4cf75975-1760-4697-8186-87ccee8ae77b from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 22:02:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:02:48 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:02:48 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 22:02:48 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:02:48 user nova-compute[75993]:   <serial>beeaee07-ffb5-481f-9efb-485ae23da7f9</serial>
Nov 08 22:02:48 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:02:48 user nova-compute[75993]: </disk>
Nov 08 22:02:48 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:02:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Successfully detached device vdb from instance 4cf75975-1760-4697-8186-87ccee8ae77b from the persistent domain config.
Nov 08 22:02:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4cf75975-1760-4697-8186-87ccee8ae77b from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 22:02:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:02:48 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:02:48 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 22:02:48 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:02:48 user nova-compute[75993]:   <serial>beeaee07-ffb5-481f-9efb-485ae23da7f9</serial>
Nov 08 22:02:48 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:02:48 user nova-compute[75993]: </disk>
Nov 08 22:02:48 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:02:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4cf75975-1760-4697-8186-87ccee8ae77b {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 22:02:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-761e600b-568b-4ab3-89ae-e15d92a92c81 req-50c3a78d-8843-4e85-a1a6-bc10c0517a9e service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-changed-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:02:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-761e600b-568b-4ab3-89ae-e15d92a92c81 req-50c3a78d-8843-4e85-a1a6-bc10c0517a9e service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Refreshing instance network info cache due to event network-changed-95040a92-cb5d-43b2-9a5a-c54f134f28f6. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:02:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-761e600b-568b-4ab3-89ae-e15d92a92c81 req-50c3a78d-8843-4e85-a1a6-bc10c0517a9e service nova] Acquiring lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:02:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-761e600b-568b-4ab3-89ae-e15d92a92c81 req-50c3a78d-8843-4e85-a1a6-bc10c0517a9e service nova] Acquired lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:02:49 user nova-compute[75993]: DEBUG nova.network.neutron [req-761e600b-568b-4ab3-89ae-e15d92a92c81 req-50c3a78d-8843-4e85-a1a6-bc10c0517a9e service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Refreshing network info cache for port 95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:02:50 user nova-compute[75993]: DEBUG nova.network.neutron [req-761e600b-568b-4ab3-89ae-e15d92a92c81 req-50c3a78d-8843-4e85-a1a6-bc10c0517a9e service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updated VIF entry in instance network info cache for port 95040a92-cb5d-43b2-9a5a-c54f134f28f6. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:02:50 user nova-compute[75993]: DEBUG nova.network.neutron [req-761e600b-568b-4ab3-89ae-e15d92a92c81 req-50c3a78d-8843-4e85-a1a6-bc10c0517a9e service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updating instance_info_cache with network_info: [{"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:02:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-761e600b-568b-4ab3-89ae-e15d92a92c81 req-50c3a78d-8843-4e85-a1a6-bc10c0517a9e service nova] Releasing lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:02:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG nova.objects.instance [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:02:56 user nova-compute[75993]: INFO nova.compute.manager [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attaching volume 2fc60d48-3bf7-4eca-85ec-403466727677 to /dev/vdb
Nov 08 22:02:56 user nova-compute[75993]: DEBUG os_brick.utils [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[891dfbbe-16fb-4c41-a13f-c8610535517a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a540186e-dba9-4cf7-9b75-8f3793c133cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1b5fa5-674a-4097-8817-f34c1016d64b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf2a047-eced-433c-9497-73282a630efe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:02:56 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:02:56 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[540aee9a-0ce2-443a-8e1a-d22c0e138a05]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG os_brick.utils [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updating existing volume attachment record: af37a642-d22b-4429-b810-f06364061503 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:02:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:02:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:03:08 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4cf75975-1760-4697-8186-87ccee8ae77b is timed out.
Nov 08 22:03:08 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Successfully detached device vdb from instance 4cf75975-1760-4697-8186-87ccee8ae77b from the live domain config.
Nov 08 22:03:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:03:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fMDVhJcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:03:08 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:03:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:03:08 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:03:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f702de8-39a9-42b2-9b35-535ecbb367fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:03:09 user nova-compute[75993]: No targets found.
Nov 08 22:03:09 user nova-compute[75993]: iSNS:
Nov 08 22:03:09 user nova-compute[75993]: No targets found.
Nov 08 22:03:09 user nova-compute[75993]: STATIC:
Nov 08 22:03:09 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76
Nov 08 22:03:09 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:03:09 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:03:09 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9
Nov 08 22:03:09 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:03:09 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:03:09 user nova-compute[75993]: FIRMWARE:
Nov 08 22:03:09 user nova-compute[75993]: No targets found.
Nov 08 22:03:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:03:09 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:03:09 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc45e843-bb17-420e-ad04-43454baf3372]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95c74c0-c83c-4aab-8cce-c21fcbd79efc]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:03:09 user nova-compute[75993]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:03:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 (non-flash)
Nov 08 22:03:09 user nova-compute[75993]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:03:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544f91bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ce2da6-7715-47ab-9d77-b5f97772572a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0a36d6-a8a2-4874-9705-45b89483f70c]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d55aed7-36b9-443d-91d3-81ee8b790e85]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6e8525-07aa-4a45-837f-192bdc4cebce]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4a4b6c-1151-454d-97a5-3455608f8568]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf63bcb-9611-4f67-82d3-a5fde4ef6fd8]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9, portal: 172.16.0.220,3260]
Nov 08 22:03:09 user nova-compute[75993]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9, portal: 172.16.0.220,3260] successful.
Nov 08 22:03:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:beeaee07-ffb5-481f-9efb-485ae23da7f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b93bc22-e849-4203-85e8-45a62bf7f65e]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] <== disconnect_volume: return (280ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:03:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:03:10 user nova-compute[75993]: DEBUG nova.objects.instance [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'flavor' on Instance uuid 4cf75975-1760-4697-8186-87ccee8ae77b {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:03:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-925b0fbf-ba71-467a-9d28-d167d7d1c168 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.780s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:03:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:13 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:03:13 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:03:13 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:03:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:03:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-02c8412a-6315-4cb4-aa2a-54eeededfe47 req-ab0bf263-9f0f-4d0c-a30b-c04dcd46823a service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-changed-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-02c8412a-6315-4cb4-aa2a-54eeededfe47 req-ab0bf263-9f0f-4d0c-a30b-c04dcd46823a service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Refreshing instance network info cache due to event network-changed-fe2d45f6-7eff-41c3-b47d-7f499f73bf33. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-02c8412a-6315-4cb4-aa2a-54eeededfe47 req-ab0bf263-9f0f-4d0c-a30b-c04dcd46823a service nova] Acquiring lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-02c8412a-6315-4cb4-aa2a-54eeededfe47 req-ab0bf263-9f0f-4d0c-a30b-c04dcd46823a service nova] Acquired lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG nova.network.neutron [req-02c8412a-6315-4cb4-aa2a-54eeededfe47 req-ab0bf263-9f0f-4d0c-a30b-c04dcd46823a service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Refreshing network info cache for port fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:14 user nova-compute[75993]: INFO nova.compute.manager [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Terminating instance
Nov 08 22:03:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-82da224d-e438-4693-9f1a-e2039d9a3513 req-48baa6c1-0194-4bed-80cc-c78093ea89d3 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-vif-unplugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-82da224d-e438-4693-9f1a-e2039d9a3513 req-48baa6c1-0194-4bed-80cc-c78093ea89d3 service nova] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-82da224d-e438-4693-9f1a-e2039d9a3513 req-48baa6c1-0194-4bed-80cc-c78093ea89d3 service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-82da224d-e438-4693-9f1a-e2039d9a3513 req-48baa6c1-0194-4bed-80cc-c78093ea89d3 service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-82da224d-e438-4693-9f1a-e2039d9a3513 req-48baa6c1-0194-4bed-80cc-c78093ea89d3 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] No waiting events found dispatching network-vif-unplugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-82da224d-e438-4693-9f1a-e2039d9a3513 req-48baa6c1-0194-4bed-80cc-c78093ea89d3 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-vif-unplugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-02c8412a-6315-4cb4-aa2a-54eeededfe47 req-ab0bf263-9f0f-4d0c-a30b-c04dcd46823a service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updated VIF entry in instance network info cache for port fe2d45f6-7eff-41c3-b47d-7f499f73bf33. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-02c8412a-6315-4cb4-aa2a-54eeededfe47 req-ab0bf263-9f0f-4d0c-a30b-c04dcd46823a service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating instance_info_cache with network_info: [{"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-02c8412a-6315-4cb4-aa2a-54eeededfe47 req-ab0bf263-9f0f-4d0c-a30b-c04dcd46823a service nova] Releasing lock "refresh_cache-3713db24-c1c7-4755-b94f-ec88b1fbc960" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:03:15 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Instance destroyed successfully.
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.objects.instance [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lazy-loading 'resources' on Instance uuid 3713db24-c1c7-4755-b94f-ec88b1fbc960 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T21:56:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1289890038',display_name='tempest-TestShelveInstance-server-1289890038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1289890038',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBYpfKFamOS8ZmffOZUH83SooiZofpo/zMgwflGnwGStjsdQwy4OitgGLlVKVUnTQ7qUq17P715+FUnTYTZWPElqsI7SoOWfJ4AQYQyb7Tt1NxCTzAFKHzDPudlIcSfDzw==',key_name='tempest-TestShelveInstance-243862016',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:01:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='482c9b5155b94bb1a5f1189ffc0c9cdc',ramdisk_id='',reservation_id='r-p0nylb07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-510215546',owner_user_name='tempest-TestShelveInstance-510215546-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:01:25Z,user_data=None,user_id='55e7e193334f4d83949bf4119b71661c',uuid=3713db24-c1c7-4755-b94f-ec88b1fbc960,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converting VIF {"id": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "address": "fa:16:3e:c5:06:b5", "network": {"id": "d1cc1135-b9bb-47ef-94b1-d0a680f72bc9", "bridge": "br-int", "label": "tempest-TestShelveInstance-782795183-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482c9b5155b94bb1a5f1189ffc0c9cdc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe2d45f6-7e", "ovs_interfaceid": "fe2d45f6-7eff-41c3-b47d-7f499f73bf33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG os_vif [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe2d45f6-7e, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9b6541e-56ec-473b-befe-637d7e0d9c80) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:15 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:03:15 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8383MB free_disk=24.903541564941406GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:15 user nova-compute[75993]: INFO os_vif [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:06:b5,bridge_name='br-int',has_traffic_filtering=True,id=fe2d45f6-7eff-41c3-b47d-7f499f73bf33,network=Network(d1cc1135-b9bb-47ef-94b1-d0a680f72bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe2d45f6-7e')
Nov 08 22:03:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FXNAgQDb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:03:15 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:03:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a59d3f-a241-4fb7-8fa5-97612ff3d7e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:03:15 user nova-compute[75993]: No targets found.
Nov 08 22:03:15 user nova-compute[75993]: iSNS:
Nov 08 22:03:15 user nova-compute[75993]: No targets found.
Nov 08 22:03:15 user nova-compute[75993]: STATIC:
Nov 08 22:03:15 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76
Nov 08 22:03:15 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:03:15 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:03:15 user nova-compute[75993]: FIRMWARE:
Nov 08 22:03:15 user nova-compute[75993]: No targets found.
Nov 08 22:03:15 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:03:15 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:03:15 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bade3f11-4a2f-488b-a893-f254b68063eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b3dc68-f42d-460d-b903-8ca84b0dc5ff]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:03:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 (non-flash)
Nov 08 22:03:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f85684665f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76'): ({'sdf'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Removing single pathed devices sdf {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ecc4cc2-d1be-486f-9256-6eb2b3517154]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1f2e921c-69cc-496c-9e19-561dcfd00a72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 91fae199-114f-4f67-b48d-1e74ede28d32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 4cf75975-1760-4697-8186-87ccee8ae77b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9ca82207-c9df-4e5f-9eae-459397b1a414 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 3713db24-c1c7-4755-b94f-ec88b1fbc960 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb46174-ab2d-4094-95c3-1a6d9c1b6f4f]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Flushing IO for device /dev/sdf {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27c5520-5a06-4bcf-ae76-05b6c916cbf0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f97907c-04db-4d1e-bcbe-91c228db4f35]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] SCSI volumes sdf have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[142125c3-05de-484c-bd9a-cbb6372d6fa7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b08ed8-35c2-4420-9f21-cc852771648b]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260]
Nov 08 22:03:16 user nova-compute[75993]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76, portal: 172.16.0.220,3260] successful.
Nov 08 22:03:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32658f8f-79d5-4fec-8cc0-db9c0142af76 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d7b4f2-86bb-4ed5-a514-989128534935]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] <== disconnect_volume: return (302ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:03:16 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Deleting instance files /opt/stack/data/nova/instances/3713db24-c1c7-4755-b94f-ec88b1fbc960_del
Nov 08 22:03:16 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Deletion of /opt/stack/data/nova/instances/3713db24-c1c7-4755-b94f-ec88b1fbc960_del complete
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:16 user nova-compute[75993]: INFO nova.compute.manager [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 08 22:03:16 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:03:16 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Took 0.62 seconds to deallocate network for instance.
Nov 08 22:03:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-962f5c2d-7bb8-49b5-b3b1-a19f22e709f2 req-cca4ad04-0974-4812-8090-5c7d8e3943c4 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-vif-deleted-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG nova.compute.manager [req-3a27f097-8ed5-4cb7-9b6b-20661eeb11be req-af35a0b1-c764-400b-b44b-2b9c9b2b85c6 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received event network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3a27f097-8ed5-4cb7-9b6b-20661eeb11be req-af35a0b1-c764-400b-b44b-2b9c9b2b85c6 service nova] Acquiring lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3a27f097-8ed5-4cb7-9b6b-20661eeb11be req-af35a0b1-c764-400b-b44b-2b9c9b2b85c6 service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3a27f097-8ed5-4cb7-9b6b-20661eeb11be req-af35a0b1-c764-400b-b44b-2b9c9b2b85c6 service nova] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG nova.compute.manager [req-3a27f097-8ed5-4cb7-9b6b-20661eeb11be req-af35a0b1-c764-400b-b44b-2b9c9b2b85c6 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] No waiting events found dispatching network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:17 user nova-compute[75993]: WARNING nova.compute.manager [req-3a27f097-8ed5-4cb7-9b6b-20661eeb11be req-af35a0b1-c764-400b-b44b-2b9c9b2b85c6 service nova] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Received unexpected event network-vif-plugged-fe2d45f6-7eff-41c3-b47d-7f499f73bf33 for instance with vm_state active and task_state deleting.
Nov 08 22:03:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updating instance_info_cache with network_info: [{"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-4cf75975-1760-4697-8186-87ccee8ae77b" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:03:17 user nova-compute[75993]: INFO nova.compute.manager [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Took 0.94 seconds to detach 1 volumes for instance.
Nov 08 22:03:17 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] [instance: 3713db24-c1c7-4755-b94f-ec88b1fbc960] Deleting volume: 32658f8f-79d5-4fec-8cc0-db9c0142af76 {{(pid=75993) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:18 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:03:18 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:03:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:18 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Deleted allocations for instance 3713db24-c1c7-4755-b94f-ec88b1fbc960
Nov 08 22:03:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8cdd9392-9c83-4564-8493-8899b587cb62 tempest-TestShelveInstance-510215546 tempest-TestShelveInstance-510215546-project-member] Lock "3713db24-c1c7-4755-b94f-ec88b1fbc960" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.645s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:18 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:03:18 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:03:18 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkfhNWsQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:03:19 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:03:19 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:03:19 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[568b29cc-26fa-46d4-89b8-04e8b7a6b61b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:03:19 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca25483-cc1f-4069-8cfb-09bb36903fc9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677] added
Nov 08 22:03:19 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[840c45b0-c721-4ff8-af3d-c8363a6375be]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32ea20b-d3e7-4858-9efc-2a456af18f4a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkfhNWsQ {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkfhNWsQ" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[db074fb1-d616-4ec2-9bb5-6c17642707d9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkfhNWsQ'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d02fb5-59f1-4dc4-ba01-9f26c865d377]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae2227b-c7aa-4796-9ce5-2e9a646659a2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:03:19 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:03:19 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:03:19 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 22:03:19 user nova-compute[75993]: 
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbe6d81-efc1-4c37-ab7e-fd6baa81872d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677, portal: 172.16.0.220,3260]
Nov 08 22:03:19 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677, portal: 172.16.0.220,3260] successful.
Nov 08 22:03:19 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8fd2c9-2b92-4c7f-b61d-6f9f08cfe370]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b9e89e-6b28-4350-87fa-b69c25481b60]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 (non-flash)
Nov 08 22:03:19 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 (non-flash)
Nov 08 22:03:19 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b714ee4-9f7d-42a0-b7cd-81df52cb7565]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:03:19 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkfhNWsQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:03:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:03:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '26664653064663336', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:03:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664653064663336', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:03:20 user nova-compute[75993]: DEBUG nova.objects.instance [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:03:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 22:03:20 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:03:20 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:03:20 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:03:20 user nova-compute[75993]:   <serial>2fc60d48-3bf7-4eca-85ec-403466727677</serial>
Nov 08 22:03:20 user nova-compute[75993]: </disk>
Nov 08 22:03:20 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 22:03:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:03:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:03:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No VIF found with MAC fa:16:3e:bb:b1:a2, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:03:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fdb40b5b-4fbd-4934-85bc-52818414a8b6 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.820s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:21 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:03:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:23 user nova-compute[75993]: INFO nova.compute.manager [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Detaching volume 2fc60d48-3bf7-4eca-85ec-403466727677
Nov 08 22:03:23 user nova-compute[75993]: INFO nova.virt.block_device [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attempting to driver detach volume 2fc60d48-3bf7-4eca-85ec-403466727677 from mountpoint /dev/vdb
Nov 08 22:03:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Attempting to detach device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 22:03:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:03:23 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:03:23 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:03:23 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:03:23 user nova-compute[75993]:   <serial>2fc60d48-3bf7-4eca-85ec-403466727677</serial>
Nov 08 22:03:23 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:03:23 user nova-compute[75993]: </disk>
Nov 08 22:03:23 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:03:23 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Successfully detached device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the persistent domain config.
Nov 08 22:03:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 22:03:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:03:23 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:03:23 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:03:23 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:03:23 user nova-compute[75993]:   <serial>2fc60d48-3bf7-4eca-85ec-403466727677</serial>
Nov 08 22:03:23 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:03:23 user nova-compute[75993]: </disk>
Nov 08 22:03:23 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:03:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 22:03:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:03:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:03:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:03:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:03:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "91fae199-114f-4f67-b48d-1e74ede28d32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:26 user nova-compute[75993]: INFO nova.compute.manager [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Terminating instance
Nov 08 22:03:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-2083d935-e636-4e7e-b5ae-3d0e5f041a65 req-3d8e91fa-c0fc-425d-9415-65bed9d3649c service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-vif-unplugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2083d935-e636-4e7e-b5ae-3d0e5f041a65 req-3d8e91fa-c0fc-425d-9415-65bed9d3649c service nova] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2083d935-e636-4e7e-b5ae-3d0e5f041a65 req-3d8e91fa-c0fc-425d-9415-65bed9d3649c service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2083d935-e636-4e7e-b5ae-3d0e5f041a65 req-3d8e91fa-c0fc-425d-9415-65bed9d3649c service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-2083d935-e636-4e7e-b5ae-3d0e5f041a65 req-3d8e91fa-c0fc-425d-9415-65bed9d3649c service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] No waiting events found dispatching network-vif-unplugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-2083d935-e636-4e7e-b5ae-3d0e5f041a65 req-3d8e91fa-c0fc-425d-9415-65bed9d3649c service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-vif-unplugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Instance destroyed successfully.
Nov 08 22:03:26 user nova-compute[75993]: DEBUG nova.objects.instance [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lazy-loading 'resources' on Instance uuid 91fae199-114f-4f67-b48d-1e74ede28d32 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1029679479',display_name='tempest-ServerActionsTestOtherA-server-1029679479',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1029679479',id=21,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIbQxx7DuVFUAXtivYRWFOk6i/ACW0OwEKdIgB2j1c2VjAAObwQ9qWcNKT6+OGS47GK/q93vubsJMppLLdAeY5qiAyBaCE0GMrdNogpncAZOwVmmfngYFO0ELy5AfYiWQ==',key_name='tempest-keypair-1988537750',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:43:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='696fc6c404c244ccba1a90b11e5437de',ramdisk_id='',reservation_id='r-65rjwq2l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1530278199',owner_user_name='tempest-ServerActionsTestOtherA-1530278199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:43:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='24c7a7bdeeda41339b11c9e9e1ad4c8d',uuid=91fae199-114f-4f67-b48d-1e74ede28d32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converting VIF {"id": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "address": "fa:16:3e:44:34:29", "network": {"id": "e6817f43-21c0-46ff-aef3-2b9f4357fade", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-198302822-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "696fc6c404c244ccba1a90b11e5437de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7dc5cf6-90", "ovs_interfaceid": "f7dc5cf6-90f1-4ec4-9704-49322e9e2179", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:34:29,bridge_name='br-int',has_traffic_filtering=True,id=f7dc5cf6-90f1-4ec4-9704-49322e9e2179,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dc5cf6-90') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG os_vif [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:34:29,bridge_name='br-int',has_traffic_filtering=True,id=f7dc5cf6-90f1-4ec4-9704-49322e9e2179,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dc5cf6-90') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7dc5cf6-90, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5b41eb9-ee30-4ae9-8850-25bacdb05933) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:03:26 user nova-compute[75993]: INFO os_vif [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:34:29,bridge_name='br-int',has_traffic_filtering=True,id=f7dc5cf6-90f1-4ec4-9704-49322e9e2179,network=Network(e6817f43-21c0-46ff-aef3-2b9f4357fade),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7dc5cf6-90')
Nov 08 22:03:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Deleting instance files /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32_del
Nov 08 22:03:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Deletion of /opt/stack/data/nova/instances/91fae199-114f-4f67-b48d-1e74ede28d32_del complete
Nov 08 22:03:27 user nova-compute[75993]: INFO nova.compute.manager [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Took 0.71 seconds to destroy the instance on the hypervisor.
Nov 08 22:03:27 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:03:27 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:03:27 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:03:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:27 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-8a7670d4-1d76-490c-b133-9487667b401a req-d900d0e6-8ca9-49a3-b103-a4668b806793 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-vif-deleted-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:28 user nova-compute[75993]: INFO nova.compute.manager [req-8a7670d4-1d76-490c-b133-9487667b401a req-d900d0e6-8ca9-49a3-b103-a4668b806793 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Neutron deleted interface f7dc5cf6-90f1-4ec4-9704-49322e9e2179; detaching it from the instance and deleting it from the info cache
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.network.neutron [req-8a7670d4-1d76-490c-b133-9487667b401a req-d900d0e6-8ca9-49a3-b103-a4668b806793 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:28 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Took 1.02 seconds to deallocate network for instance.
Nov 08 22:03:28 user nova-compute[75993]: INFO nova.compute.manager [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Terminating instance
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-8a7670d4-1d76-490c-b133-9487667b401a req-d900d0e6-8ca9-49a3-b103-a4668b806793 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Detach interface failed, port_id=f7dc5cf6-90f1-4ec4-9704-49322e9e2179, reason: Instance 91fae199-114f-4f67-b48d-1e74ede28d32 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:28 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Deleted allocations for instance 91fae199-114f-4f67-b48d-1e74ede28d32
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-c884cf4d-0e03-4b26-8905-9b625513f789 req-3b73099a-0a98-4cbf-a1aa-3c2bd9863f77 service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Received event network-vif-unplugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c884cf4d-0e03-4b26-8905-9b625513f789 req-3b73099a-0a98-4cbf-a1aa-3c2bd9863f77 service nova] Acquiring lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c884cf4d-0e03-4b26-8905-9b625513f789 req-3b73099a-0a98-4cbf-a1aa-3c2bd9863f77 service nova] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c884cf4d-0e03-4b26-8905-9b625513f789 req-3b73099a-0a98-4cbf-a1aa-3c2bd9863f77 service nova] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-c884cf4d-0e03-4b26-8905-9b625513f789 req-3b73099a-0a98-4cbf-a1aa-3c2bd9863f77 service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] No waiting events found dispatching network-vif-unplugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-c884cf4d-0e03-4b26-8905-9b625513f789 req-3b73099a-0a98-4cbf-a1aa-3c2bd9863f77 service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Received event network-vif-unplugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-88e12637-e59a-47bc-8b5d-b9181bc5f8ed tempest-ServerActionsTestOtherA-1530278199 tempest-ServerActionsTestOtherA-1530278199-project-member] Lock "91fae199-114f-4f67-b48d-1e74ede28d32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.216s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:28 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Instance destroyed successfully.
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.objects.instance [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lazy-loading 'resources' on Instance uuid 1f2e921c-69cc-496c-9e19-561dcfd00a72 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:42:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-176746582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-176746582',id=18,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:42:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb1547c59f8e4d85ad6f650b01243357',ramdisk_id='',reservation_id='r-fchel5vh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-571934265',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:44:43Z,user_data=None,user_id='78965be8230646288b7fc0443c3f4f6c',uuid=1f2e921c-69cc-496c-9e19-561dcfd00a72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converting VIF {"id": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "address": "fa:16:3e:09:04:94", "network": {"id": "e3bc9b57-f5bc-448b-95c7-03e827bca340", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1955979257-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb1547c59f8e4d85ad6f650b01243357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0885ce8e-2d", "ovs_interfaceid": "0885ce8e-2d4b-49fb-891a-3980b0f93ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:04:94,bridge_name='br-int',has_traffic_filtering=True,id=0885ce8e-2d4b-49fb-891a-3980b0f93ed3,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0885ce8e-2d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG os_vif [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:04:94,bridge_name='br-int',has_traffic_filtering=True,id=0885ce8e-2d4b-49fb-891a-3980b0f93ed3,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0885ce8e-2d') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0885ce8e-2d, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=671aa2a1-e118-487c-b281-6ba4f72ca485) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:03:28 user nova-compute[75993]: INFO os_vif [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:04:94,bridge_name='br-int',has_traffic_filtering=True,id=0885ce8e-2d4b-49fb-891a-3980b0f93ed3,network=Network(e3bc9b57-f5bc-448b-95c7-03e827bca340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0885ce8e-2d')
Nov 08 22:03:28 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Deleting instance files /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72_del
Nov 08 22:03:28 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Deletion of /opt/stack/data/nova/instances/1f2e921c-69cc-496c-9e19-561dcfd00a72_del complete
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] No waiting events found dispatching network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:28 user nova-compute[75993]: WARNING nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received unexpected event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 for instance with vm_state deleted and task_state None.
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] No waiting events found dispatching network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:28 user nova-compute[75993]: WARNING nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received unexpected event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 for instance with vm_state deleted and task_state None.
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] No waiting events found dispatching network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:28 user nova-compute[75993]: WARNING nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received unexpected event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 for instance with vm_state deleted and task_state None.
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-vif-unplugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] No waiting events found dispatching network-vif-unplugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:28 user nova-compute[75993]: WARNING nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received unexpected event network-vif-unplugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 for instance with vm_state deleted and task_state None.
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Acquiring lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] Lock "91fae199-114f-4f67-b48d-1e74ede28d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] No waiting events found dispatching network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:28 user nova-compute[75993]: WARNING nova.compute.manager [req-91757041-c95f-4b77-af7a-f3969e07c337 req-8ab84a14-cc62-409c-8e8b-1def060ea189 service nova] [instance: 91fae199-114f-4f67-b48d-1e74ede28d32] Received unexpected event network-vif-plugged-f7dc5cf6-90f1-4ec4-9704-49322e9e2179 for instance with vm_state deleted and task_state None.
Nov 08 22:03:28 user nova-compute[75993]: INFO nova.compute.manager [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 08 22:03:28 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:03:28 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:03:29 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:03:29 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Took 0.48 seconds to deallocate network for instance.
Nov 08 22:03:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:29 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:03:29 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:03:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:29 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Deleted allocations for instance 1f2e921c-69cc-496c-9e19-561dcfd00a72
Nov 08 22:03:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-eb419a61-5a67-4efb-90db-bbe0353af398 tempest-ServerBootFromVolumeStableRescueTest-571934265 tempest-ServerBootFromVolumeStableRescueTest-571934265-project-member] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.557s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-d54cbf8a-1ed0-4c02-ad57-adb0b69cfd0d req-f1b38353-ddd9-4ff5-9d7d-1c35ba0b52dd service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Received event network-vif-deleted-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-095f6797-8b45-41d4-ba6b-dfe7b88f92ca req-dfdecccf-1786-4d20-aff2-d0c212deef7c service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Received event network-vif-plugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-095f6797-8b45-41d4-ba6b-dfe7b88f92ca req-dfdecccf-1786-4d20-aff2-d0c212deef7c service nova] Acquiring lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-095f6797-8b45-41d4-ba6b-dfe7b88f92ca req-dfdecccf-1786-4d20-aff2-d0c212deef7c service nova] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-095f6797-8b45-41d4-ba6b-dfe7b88f92ca req-dfdecccf-1786-4d20-aff2-d0c212deef7c service nova] Lock "1f2e921c-69cc-496c-9e19-561dcfd00a72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:30 user nova-compute[75993]: DEBUG nova.compute.manager [req-095f6797-8b45-41d4-ba6b-dfe7b88f92ca req-dfdecccf-1786-4d20-aff2-d0c212deef7c service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] No waiting events found dispatching network-vif-plugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:30 user nova-compute[75993]: WARNING nova.compute.manager [req-095f6797-8b45-41d4-ba6b-dfe7b88f92ca req-dfdecccf-1786-4d20-aff2-d0c212deef7c service nova] [instance: 1f2e921c-69cc-496c-9e19-561dcfd00a72] Received unexpected event network-vif-plugged-0885ce8e-2d4b-49fb-891a-3980b0f93ed3 for instance with vm_state deleted and task_state None.
Nov 08 22:03:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:03:43 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 is timed out.
Nov 08 22:03:43 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Successfully detached device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the live domain config.
Nov 08 22:03:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:03:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkfhNWsQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:03:43 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:03:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:03:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:03:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2212fc5e-ed3b-4d90-8f8f-aece7cee12c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:03:44 user nova-compute[75993]: No targets found.
Nov 08 22:03:44 user nova-compute[75993]: iSNS:
Nov 08 22:03:44 user nova-compute[75993]: No targets found.
Nov 08 22:03:44 user nova-compute[75993]: STATIC:
Nov 08 22:03:44 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677
Nov 08 22:03:44 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:03:44 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:03:44 user nova-compute[75993]: FIRMWARE:
Nov 08 22:03:44 user nova-compute[75993]: No targets found.
Nov 08 22:03:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:03:44 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:03:44 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ce2e0c-8d2a-4ea6-9326-14d691066e46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c7a8b1-2381-453e-94cc-d91f6081ed50]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 (non-flash)
Nov 08 22:03:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 (non-flash)
Nov 08 22:03:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544f9de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa6ed1-0d0f-4636-8fea-26ae5b271028]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[15544f4d-b7d4-4d4d-bc4f-7fac23b1b77c]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f2a0e3-9e4e-408f-bf2a-c67f8acfd76f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc89209-efdb-4576-86eb-fdaa7d767b55]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6225d32-10cd-4072-9a9f-cf6306db5ef3]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d8dc6f-b0c8-42cf-9c09-9024f7abc874]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677, portal: 172.16.0.220,3260]
Nov 08 22:03:44 user nova-compute[75993]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677, portal: 172.16.0.220,3260] successful.
Nov 08 22:03:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc60d48-3bf7-4eca-85ec-403466727677 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf8437f-0667-44b9-919d-950c1e61e912]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== disconnect_volume: return (309ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:03:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:03:45 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:03:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e2b1a034-7502-499d-b1e9-a0040725e60b tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.808s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:49 user nova-compute[75993]: INFO nova.compute.manager [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Terminating instance
Nov 08 22:03:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-9f75815d-da75-4954-be6d-4b23c9c07ee0 req-4921a48c-9a66-498a-b419-02e0628bd195 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-unplugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9f75815d-da75-4954-be6d-4b23c9c07ee0 req-4921a48c-9a66-498a-b419-02e0628bd195 service nova] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9f75815d-da75-4954-be6d-4b23c9c07ee0 req-4921a48c-9a66-498a-b419-02e0628bd195 service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9f75815d-da75-4954-be6d-4b23c9c07ee0 req-4921a48c-9a66-498a-b419-02e0628bd195 service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-9f75815d-da75-4954-be6d-4b23c9c07ee0 req-4921a48c-9a66-498a-b419-02e0628bd195 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] No waiting events found dispatching network-vif-unplugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-9f75815d-da75-4954-be6d-4b23c9c07ee0 req-4921a48c-9a66-498a-b419-02e0628bd195 service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-unplugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Instance destroyed successfully.
Nov 08 22:03:50 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lazy-loading 'resources' on Instance uuid 4cf75975-1760-4697-8186-87ccee8ae77b {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2053641649',display_name='tempest-TestMinimumBasicScenario-server-2053641649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2053641649',id=35,image_ref='868f02a6-975b-4c46-9946-7b665df308ca',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5JIaYYS6mJygvwfP+ooR3+z/eHWshdF32wmW9uMBngeQ8pLGawJ1cHryaOBMk0cTXqvy19MlXg2DnStIoQvTwGCRIMxBl1xhSjafzuDdJ5Tcx3oLJFX9LZQaKoPZJugg==',key_name='tempest-TestMinimumBasicScenario-164345626',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:58:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dcb84908fd7c41c29be354f4710f3296',ramdisk_id='',reservation_id='r-seuukvgn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='868f02a6-975b-4c46-9946-7b665df308ca',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1615594861',owner_user_name='tempest-TestMinimumBasicScenario-1615594861-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:01:03Z,user_data=None,user_id='17537606bbf046cd84a615eb779bab16',uuid=4cf75975-1760-4697-8186-87ccee8ae77b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converting VIF {"id": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "address": "fa:16:3e:2e:f7:31", "network": {"id": "b4fdf0f9-e366-416c-9787-5bfb60819254", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1379835262-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dcb84908fd7c41c29be354f4710f3296", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95040a92-cb", "ovs_interfaceid": "95040a92-cb5d-43b2-9a5a-c54f134f28f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:31,bridge_name='br-int',has_traffic_filtering=True,id=95040a92-cb5d-43b2-9a5a-c54f134f28f6,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95040a92-cb') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG os_vif [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:31,bridge_name='br-int',has_traffic_filtering=True,id=95040a92-cb5d-43b2-9a5a-c54f134f28f6,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95040a92-cb') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95040a92-cb, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f004ec74-a639-421d-895f-11089accbd4f) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:03:50 user nova-compute[75993]: INFO os_vif [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:f7:31,bridge_name='br-int',has_traffic_filtering=True,id=95040a92-cb5d-43b2-9a5a-c54f134f28f6,network=Network(b4fdf0f9-e366-416c-9787-5bfb60819254),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95040a92-cb')
Nov 08 22:03:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Deleting instance files /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b_del
Nov 08 22:03:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Deletion of /opt/stack/data/nova/instances/4cf75975-1760-4697-8186-87ccee8ae77b_del complete
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: INFO nova.compute.manager [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 08 22:03:50 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:03:51 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Took 1.15 seconds to deallocate network for instance.
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:51 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Deleted allocations for instance 4cf75975-1760-4697-8186-87ccee8ae77b
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ec2ecf95-2a4a-41fe-b0bd-33e30911b929 tempest-TestMinimumBasicScenario-1615594861 tempest-TestMinimumBasicScenario-1615594861-project-member] Lock "4cf75975-1760-4697-8186-87ccee8ae77b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.335s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] No waiting events found dispatching network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:51 user nova-compute[75993]: WARNING nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received unexpected event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 for instance with vm_state deleted and task_state None.
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] No waiting events found dispatching network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:51 user nova-compute[75993]: WARNING nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received unexpected event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 for instance with vm_state deleted and task_state None.
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] No waiting events found dispatching network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:51 user nova-compute[75993]: WARNING nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received unexpected event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 for instance with vm_state deleted and task_state None.
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Acquiring lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] Lock "4cf75975-1760-4697-8186-87ccee8ae77b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] No waiting events found dispatching network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:03:51 user nova-compute[75993]: WARNING nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received unexpected event network-vif-plugged-95040a92-cb5d-43b2-9a5a-c54f134f28f6 for instance with vm_state deleted and task_state None.
Nov 08 22:03:51 user nova-compute[75993]: DEBUG nova.compute.manager [req-e1384a5e-7f95-457e-973b-0bbeaa759cbe req-abb47816-cc60-4fb9-850c-5c61c3caf78d service nova] [instance: 4cf75975-1760-4697-8186-87ccee8ae77b] Received event network-vif-deleted-95040a92-cb5d-43b2-9a5a-c54f134f28f6 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:03:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:04:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:04:13 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:04:13 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:04:13 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:04:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:13 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:04:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:13 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:14 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:04:14 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:04:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8739MB free_disk=25.08218765258789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:04:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9ca82207-c9df-4e5f-9eae-459397b1a414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:04:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:04:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:04:14 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:04:14 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:04:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:04:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:04:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:04:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:04:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:04:15 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:04:16 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updating instance_info_cache with network_info: [{"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:04:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:04:16 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:04:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:04:19 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:04:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:19 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:20 user nova-compute[75993]: INFO nova.compute.manager [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attaching volume 858a797d-2e66-4332-96d3-a2431ec3ee3c to /dev/vdb
Nov 08 22:04:20 user nova-compute[75993]: DEBUG os_brick.utils [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de5a206-8913-4bb2-a34a-17cf79251d81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae46c7f-211d-478f-82bc-3eaf7f968115]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc15d2b-e426-4e52-8c58-f8114614070c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[625c1f0c-94e6-41fe-93b3-b385b8f8801f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:04:20 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e0dead-9500-43a8-ae6d-5c0178db5eef]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG os_brick.utils [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updating existing volume attachment record: a8efce30-15c0-4560-b198-a9b1816382c9 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:04:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:21 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:04:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:26 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:04:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:04:32 user nova-compute[75993]: INFO nova.compute.claims [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Claim successful on node user
Nov 08 22:04:32 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.270s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:04:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:04:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:04:32 user nova-compute[75993]: DEBUG nova.policy [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28f123ed5d424009a2de634bf8f5e287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65fbb6d9c1ac42ddb05ca4a04e926c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:04:33 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Creating image(s)
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "/opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "/opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.239s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:04:33 user nova-compute[75993]: INFO nova.compute.claims [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Claim successful on node user
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.197s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Successfully created port: 421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk 1073741824" returned: 0 in 0.073s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.240s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:04:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:04:34 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Cannot resize image /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Ensure instance console log exists: /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.policy [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ddac60afc3b4fe9a9f85774fd1b8513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7a28285c5c4db9aa84b223a2235839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:04:34 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Creating image(s)
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "/opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "/opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "/opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.214s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Successfully updated port: 421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk 1073741824" returned: 0 in 0.070s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquired lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-6711d440-2809-43e1-bcee-21d83b0b6e08 req-e52089e8-7a82-436f-8ca3-35582d963166 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Received event network-changed-421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-6711d440-2809-43e1-bcee-21d83b0b6e08 req-e52089e8-7a82-436f-8ca3-35582d963166 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Refreshing instance network info cache due to event network-changed-421d9dac-414a-47d7-ba54-a3e5158d6b9c. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6711d440-2809-43e1-bcee-21d83b0b6e08 req-e52089e8-7a82-436f-8ca3-35582d963166 service nova] Acquiring lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 22:04:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Successfully created port: bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Cannot resize image /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Ensure instance console log exists: /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updating instance_info_cache with network_info: [{"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Releasing lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Instance network_info: |[{"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6711d440-2809-43e1-bcee-21d83b0b6e08 req-e52089e8-7a82-436f-8ca3-35582d963166 service nova] Acquired lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.neutron [req-6711d440-2809-43e1-bcee-21d83b0b6e08 req-e52089e8-7a82-436f-8ca3-35582d963166 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Refreshing network info cache for port 421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Start _get_guest_xml network_info=[{"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:04:35 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:04:35 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-512144214',display_name='tempest-ServersNegativeTestJSON-server-512144214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-512144214',id=38,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65fbb6d9c1ac42ddb05ca4a04e926c32',ramdisk_id='',reservation_id='r-6017phm2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1194338669',owner_user_name='tempest-ServersNegativeTestJSON-1194338669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:04:33Z,user_data=None,user_id='28f123ed5d424009a2de634bf8f5e287',uuid=7fa742a1-5f77-4e70-ad1e-649c7a37a5ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converting VIF {"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c2:5d,bridge_name='br-int',has_traffic_filtering=True,id=421d9dac-414a-47d7-ba54-a3e5158d6b9c,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap421d9dac-41') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.objects.instance [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:04:35 user nova-compute[75993]:   <uuid>7fa742a1-5f77-4e70-ad1e-649c7a37a5ce</uuid>
Nov 08 22:04:35 user nova-compute[75993]:   <name>instance-00000026</name>
Nov 08 22:04:35 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:04:35 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:04:35 user nova-compute[75993]:   <metadata>
Nov 08 22:04:35 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:04:35 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:04:35 user nova-compute[75993]:       <nova:name>tempest-ServersNegativeTestJSON-server-512144214</nova:name>
Nov 08 22:04:35 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:04:35</nova:creationTime>
Nov 08 22:04:35 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:04:35 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:04:35 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:04:35 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:04:35 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:04:35 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:04:35 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:04:35 user nova-compute[75993]:       <nova:owner>
Nov 08 22:04:35 user nova-compute[75993]:         <nova:user uuid="28f123ed5d424009a2de634bf8f5e287">tempest-ServersNegativeTestJSON-1194338669-project-member</nova:user>
Nov 08 22:04:35 user nova-compute[75993]:         <nova:project uuid="65fbb6d9c1ac42ddb05ca4a04e926c32">tempest-ServersNegativeTestJSON-1194338669</nova:project>
Nov 08 22:04:35 user nova-compute[75993]:       </nova:owner>
Nov 08 22:04:35 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 22:04:35 user nova-compute[75993]:       <nova:ports>
Nov 08 22:04:35 user nova-compute[75993]:         <nova:port uuid="421d9dac-414a-47d7-ba54-a3e5158d6b9c">
Nov 08 22:04:35 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 08 22:04:35 user nova-compute[75993]:         </nova:port>
Nov 08 22:04:35 user nova-compute[75993]:       </nova:ports>
Nov 08 22:04:35 user nova-compute[75993]:     </nova:instance>
Nov 08 22:04:35 user nova-compute[75993]:   </metadata>
Nov 08 22:04:35 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:04:35 user nova-compute[75993]:     <system>
Nov 08 22:04:35 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:04:35 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:04:35 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:04:35 user nova-compute[75993]:       <entry name="serial">7fa742a1-5f77-4e70-ad1e-649c7a37a5ce</entry>
Nov 08 22:04:35 user nova-compute[75993]:       <entry name="uuid">7fa742a1-5f77-4e70-ad1e-649c7a37a5ce</entry>
Nov 08 22:04:35 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:04:35 user nova-compute[75993]:     </system>
Nov 08 22:04:35 user nova-compute[75993]:   </sysinfo>
Nov 08 22:04:35 user nova-compute[75993]:   <os>
Nov 08 22:04:35 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:04:35 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:04:35 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:04:35 user nova-compute[75993]:   </os>
Nov 08 22:04:35 user nova-compute[75993]:   <features>
Nov 08 22:04:35 user nova-compute[75993]:     <acpi/>
Nov 08 22:04:35 user nova-compute[75993]:     <apic/>
Nov 08 22:04:35 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:04:35 user nova-compute[75993]:   </features>
Nov 08 22:04:35 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:04:35 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:04:35 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:04:35 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:04:35 user nova-compute[75993]:   </clock>
Nov 08 22:04:35 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:04:35 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:04:35 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:04:35 user nova-compute[75993]:   </cpu>
Nov 08 22:04:35 user nova-compute[75993]:   <devices>
Nov 08 22:04:35 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 22:04:35 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 22:04:35 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk"/>
Nov 08 22:04:35 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:04:35 user nova-compute[75993]:     </disk>
Nov 08 22:04:35 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:04:35 user nova-compute[75993]:       <mac address="fa:16:3e:e2:c2:5d"/>
Nov 08 22:04:35 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:04:35 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:04:35 user nova-compute[75993]:       <target dev="tap421d9dac-41"/>
Nov 08 22:04:35 user nova-compute[75993]:     </interface>
Nov 08 22:04:35 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:04:35 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/console.log" append="off"/>
Nov 08 22:04:35 user nova-compute[75993]:     </serial>
Nov 08 22:04:35 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:04:35 user nova-compute[75993]:     <video>
Nov 08 22:04:35 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:04:35 user nova-compute[75993]:     </video>
Nov 08 22:04:35 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:04:35 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:04:35 user nova-compute[75993]:     </rng>
Nov 08 22:04:35 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:04:35 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:04:35 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:04:35 user nova-compute[75993]:     </memballoon>
Nov 08 22:04:35 user nova-compute[75993]:   </devices>
Nov 08 22:04:35 user nova-compute[75993]: </domain>
Nov 08 22:04:35 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-512144214',display_name='tempest-ServersNegativeTestJSON-server-512144214',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-512144214',id=38,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65fbb6d9c1ac42ddb05ca4a04e926c32',ramdisk_id='',reservation_id='r-6017phm2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1194338669',owner_user_name='tempest-ServersNegativeTestJSON-1194338669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:04:33Z,user_data=None,user_id='28f123ed5d424009a2de634bf8f5e287',uuid=7fa742a1-5f77-4e70-ad1e-649c7a37a5ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converting VIF {"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c2:5d,bridge_name='br-int',has_traffic_filtering=True,id=421d9dac-414a-47d7-ba54-a3e5158d6b9c,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap421d9dac-41') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG os_vif [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c2:5d,bridge_name='br-int',has_traffic_filtering=True,id=421d9dac-414a-47d7-ba54-a3e5158d6b9c,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap421d9dac-41') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '432d3913-01c8-5cc8-901e-349899ab29c3', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap421d9dac-41, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap421d9dac-41, col_values=(('qos', UUID('bf8fe23c-4888-4255-af26-4d77b2e8400f')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap421d9dac-41, col_values=(('external_ids', {'iface-id': '421d9dac-414a-47d7-ba54-a3e5158d6b9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:c2:5d', 'vm-uuid': '7fa742a1-5f77-4e70-ad1e-649c7a37a5ce'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:35 user nova-compute[75993]: INFO os_vif [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:c2:5d,bridge_name='br-int',has_traffic_filtering=True,id=421d9dac-414a-47d7-ba54-a3e5158d6b9c,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap421d9dac-41')
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] No VIF found with MAC fa:16:3e:e2:c2:5d, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.neutron [req-6711d440-2809-43e1-bcee-21d83b0b6e08 req-e52089e8-7a82-436f-8ca3-35582d963166 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updated VIF entry in instance network info cache for port 421d9dac-414a-47d7-ba54-a3e5158d6b9c. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.neutron [req-6711d440-2809-43e1-bcee-21d83b0b6e08 req-e52089e8-7a82-436f-8ca3-35582d963166 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updating instance_info_cache with network_info: [{"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6711d440-2809-43e1-bcee-21d83b0b6e08 req-e52089e8-7a82-436f-8ca3-35582d963166 service nova] Releasing lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Successfully updated port: bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquired lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-dce4b2ae-13f2-4bdc-b75a-bce3cbe070b9 req-f47fb45e-4d4d-4257-8b3a-36f7e791d362 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-changed-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-dce4b2ae-13f2-4bdc-b75a-bce3cbe070b9 req-f47fb45e-4d4d-4257-8b3a-36f7e791d362 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Refreshing instance network info cache due to event network-changed-bf9fae23-01fc-42f3-9702-31dcf3b7e62c. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dce4b2ae-13f2-4bdc-b75a-bce3cbe070b9 req-f47fb45e-4d4d-4257-8b3a-36f7e791d362 service nova] Acquiring lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:04:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.network.neutron [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updating instance_info_cache with network_info: [{"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Releasing lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Instance network_info: |[{"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dce4b2ae-13f2-4bdc-b75a-bce3cbe070b9 req-f47fb45e-4d4d-4257-8b3a-36f7e791d362 service nova] Acquired lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.network.neutron [req-dce4b2ae-13f2-4bdc-b75a-bce3cbe070b9 req-f47fb45e-4d4d-4257-8b3a-36f7e791d362 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Refreshing network info cache for port bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Start _get_guest_xml network_info=[{"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:04:36 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:04:36 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1163902224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1163902224',id=39,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/Q9bI9MR90o4Ahm70g4BIr1RNc+/EEReShm0yw+Tiw6vOii9fjJC0oNDuJ9ggGmvtmKXq/A4wcu62Aqk6G/yLPrmvb79FVhli9DXoQsXwPbFGi5MS7KXjdvPpGPabGxQ==',key_name='tempest-keypair-1346375788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-380o1u8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.objects.instance [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'pci_devices' on Instance uuid 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:04:36 user nova-compute[75993]:   <uuid>31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad</uuid>
Nov 08 22:04:36 user nova-compute[75993]:   <name>instance-00000027</name>
Nov 08 22:04:36 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:04:36 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:04:36 user nova-compute[75993]:   <metadata>
Nov 08 22:04:36 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:04:36 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:04:36 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1163902224</nova:name>
Nov 08 22:04:36 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:04:36</nova:creationTime>
Nov 08 22:04:36 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:04:36 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:04:36 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:04:36 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:04:36 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:04:36 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:04:36 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:04:36 user nova-compute[75993]:       <nova:owner>
Nov 08 22:04:36 user nova-compute[75993]:         <nova:user uuid="2ddac60afc3b4fe9a9f85774fd1b8513">tempest-AttachVolumeShelveTestJSON-1533063344-project-member</nova:user>
Nov 08 22:04:36 user nova-compute[75993]:         <nova:project uuid="cb7a28285c5c4db9aa84b223a2235839">tempest-AttachVolumeShelveTestJSON-1533063344</nova:project>
Nov 08 22:04:36 user nova-compute[75993]:       </nova:owner>
Nov 08 22:04:36 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 22:04:36 user nova-compute[75993]:       <nova:ports>
Nov 08 22:04:36 user nova-compute[75993]:         <nova:port uuid="bf9fae23-01fc-42f3-9702-31dcf3b7e62c">
Nov 08 22:04:36 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 22:04:36 user nova-compute[75993]:         </nova:port>
Nov 08 22:04:36 user nova-compute[75993]:       </nova:ports>
Nov 08 22:04:36 user nova-compute[75993]:     </nova:instance>
Nov 08 22:04:36 user nova-compute[75993]:   </metadata>
Nov 08 22:04:36 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:04:36 user nova-compute[75993]:     <system>
Nov 08 22:04:36 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:04:36 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:04:36 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:04:36 user nova-compute[75993]:       <entry name="serial">31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad</entry>
Nov 08 22:04:36 user nova-compute[75993]:       <entry name="uuid">31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad</entry>
Nov 08 22:04:36 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:04:36 user nova-compute[75993]:     </system>
Nov 08 22:04:36 user nova-compute[75993]:   </sysinfo>
Nov 08 22:04:36 user nova-compute[75993]:   <os>
Nov 08 22:04:36 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:04:36 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:04:36 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:04:36 user nova-compute[75993]:   </os>
Nov 08 22:04:36 user nova-compute[75993]:   <features>
Nov 08 22:04:36 user nova-compute[75993]:     <acpi/>
Nov 08 22:04:36 user nova-compute[75993]:     <apic/>
Nov 08 22:04:36 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:04:36 user nova-compute[75993]:   </features>
Nov 08 22:04:36 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:04:36 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:04:36 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:04:36 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:04:36 user nova-compute[75993]:   </clock>
Nov 08 22:04:36 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:04:36 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:04:36 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:04:36 user nova-compute[75993]:   </cpu>
Nov 08 22:04:36 user nova-compute[75993]:   <devices>
Nov 08 22:04:36 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 22:04:36 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 22:04:36 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk"/>
Nov 08 22:04:36 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:04:36 user nova-compute[75993]:     </disk>
Nov 08 22:04:36 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:04:36 user nova-compute[75993]:       <mac address="fa:16:3e:b1:b8:bf"/>
Nov 08 22:04:36 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:04:36 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:04:36 user nova-compute[75993]:       <target dev="tapbf9fae23-01"/>
Nov 08 22:04:36 user nova-compute[75993]:     </interface>
Nov 08 22:04:36 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:04:36 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/console.log" append="off"/>
Nov 08 22:04:36 user nova-compute[75993]:     </serial>
Nov 08 22:04:36 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:04:36 user nova-compute[75993]:     <video>
Nov 08 22:04:36 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:04:36 user nova-compute[75993]:     </video>
Nov 08 22:04:36 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:04:36 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:04:36 user nova-compute[75993]:     </rng>
Nov 08 22:04:36 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:04:36 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:04:36 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:04:36 user nova-compute[75993]:     </memballoon>
Nov 08 22:04:36 user nova-compute[75993]:   </devices>
Nov 08 22:04:36 user nova-compute[75993]: </domain>
Nov 08 22:04:36 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1163902224',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1163902224',id=39,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/Q9bI9MR90o4Ahm70g4BIr1RNc+/EEReShm0yw+Tiw6vOii9fjJC0oNDuJ9ggGmvtmKXq/A4wcu62Aqk6G/yLPrmvb79FVhli9DXoQsXwPbFGi5MS7KXjdvPpGPabGxQ==',key_name='tempest-keypair-1346375788',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-380o1u8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:04:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG os_vif [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd1e2027-d865-5ecb-be1a-b5ffa99ef0aa', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf9fae23-01, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf9fae23-01, col_values=(('qos', UUID('fee3d08f-e4fa-4888-bb0d-f0777fc01cc3')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf9fae23-01, col_values=(('external_ids', {'iface-id': 'bf9fae23-01fc-42f3-9702-31dcf3b7e62c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:b8:bf', 'vm-uuid': '31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:36 user nova-compute[75993]: INFO os_vif [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01')
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] No VIF found with MAC fa:16:3e:b1:b8:bf, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.network.neutron [req-dce4b2ae-13f2-4bdc-b75a-bce3cbe070b9 req-f47fb45e-4d4d-4257-8b3a-36f7e791d362 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updated VIF entry in instance network info cache for port bf9fae23-01fc-42f3-9702-31dcf3b7e62c. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.network.neutron [req-dce4b2ae-13f2-4bdc-b75a-bce3cbe070b9 req-f47fb45e-4d4d-4257-8b3a-36f7e791d362 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updating instance_info_cache with network_info: [{"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dce4b2ae-13f2-4bdc-b75a-bce3cbe070b9 req-f47fb45e-4d4d-4257-8b3a-36f7e791d362 service nova] Releasing lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-76c32220-af7c-4866-93f1-29af66c22131 req-99451319-912f-44f4-9e56-4d2b0531150d service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Received event network-vif-plugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-76c32220-af7c-4866-93f1-29af66c22131 req-99451319-912f-44f4-9e56-4d2b0531150d service nova] Acquiring lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-76c32220-af7c-4866-93f1-29af66c22131 req-99451319-912f-44f4-9e56-4d2b0531150d service nova] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-76c32220-af7c-4866-93f1-29af66c22131 req-99451319-912f-44f4-9e56-4d2b0531150d service nova] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-76c32220-af7c-4866-93f1-29af66c22131 req-99451319-912f-44f4-9e56-4d2b0531150d service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] No waiting events found dispatching network-vif-plugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:04:36 user nova-compute[75993]: WARNING nova.compute.manager [req-76c32220-af7c-4866-93f1-29af66c22131 req-99451319-912f-44f4-9e56-4d2b0531150d service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Received unexpected event network-vif-plugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c for instance with vm_state building and task_state spawning.
Nov 08 22:04:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-89b51b8a-34cf-4b1c-85ff-e44504e06373 req-adb509b5-f589-42b3-a9ed-43c0bb6e61c9 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-89b51b8a-34cf-4b1c-85ff-e44504e06373 req-adb509b5-f589-42b3-a9ed-43c0bb6e61c9 service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-89b51b8a-34cf-4b1c-85ff-e44504e06373 req-adb509b5-f589-42b3-a9ed-43c0bb6e61c9 service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-89b51b8a-34cf-4b1c-85ff-e44504e06373 req-adb509b5-f589-42b3-a9ed-43c0bb6e61c9 service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-89b51b8a-34cf-4b1c-85ff-e44504e06373 req-adb509b5-f589-42b3-a9ed-43c0bb6e61c9 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:04:38 user nova-compute[75993]: WARNING nova.compute.manager [req-89b51b8a-34cf-4b1c-85ff-e44504e06373 req-adb509b5-f589-42b3-a9ed-43c0bb6e61c9 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received unexpected event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with vm_state building and task_state spawning.
Nov 08 22:04:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-7277a845-2288-444f-bcf1-85fefb9cc612 req-b5d9f60f-1aa7-409e-8d45-1d423958d9f3 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Received event network-vif-plugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7277a845-2288-444f-bcf1-85fefb9cc612 req-b5d9f60f-1aa7-409e-8d45-1d423958d9f3 service nova] Acquiring lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7277a845-2288-444f-bcf1-85fefb9cc612 req-b5d9f60f-1aa7-409e-8d45-1d423958d9f3 service nova] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7277a845-2288-444f-bcf1-85fefb9cc612 req-b5d9f60f-1aa7-409e-8d45-1d423958d9f3 service nova] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:38 user nova-compute[75993]: DEBUG nova.compute.manager [req-7277a845-2288-444f-bcf1-85fefb9cc612 req-b5d9f60f-1aa7-409e-8d45-1d423958d9f3 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] No waiting events found dispatching network-vif-plugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:04:38 user nova-compute[75993]: WARNING nova.compute.manager [req-7277a845-2288-444f-bcf1-85fefb9cc612 req-b5d9f60f-1aa7-409e-8d45-1d423958d9f3 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Received unexpected event network-vif-plugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c for instance with vm_state building and task_state spawning.
Nov 08 22:04:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:04:40 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Instance spawned successfully.
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: INFO nova.compute.manager [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Took 7.33 seconds to spawn the instance on the hypervisor.
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:04:40 user nova-compute[75993]: INFO nova.compute.manager [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Took 8.11 seconds to build instance.
Nov 08 22:04:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b8d15325-ec77-4234-9482-8f45605c6c15 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.227s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-e38b77c5-e3f9-4971-b485-5b8cec312b9e req-60bb341a-a831-487f-8fb8-b69423050078 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e38b77c5-e3f9-4971-b485-5b8cec312b9e req-60bb341a-a831-487f-8fb8-b69423050078 service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e38b77c5-e3f9-4971-b485-5b8cec312b9e req-60bb341a-a831-487f-8fb8-b69423050078 service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-e38b77c5-e3f9-4971-b485-5b8cec312b9e req-60bb341a-a831-487f-8fb8-b69423050078 service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-e38b77c5-e3f9-4971-b485-5b8cec312b9e req-60bb341a-a831-487f-8fb8-b69423050078 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:04:40 user nova-compute[75993]: WARNING nova.compute.manager [req-e38b77c5-e3f9-4971-b485-5b8cec312b9e req-60bb341a-a831-487f-8fb8-b69423050078 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received unexpected event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with vm_state building and task_state spawning.
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:04:40 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Instance spawned successfully.
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:04:40 user nova-compute[75993]: INFO nova.compute.manager [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 08 22:04:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:04:41 user nova-compute[75993]: INFO nova.compute.manager [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Took 7.63 seconds to build instance.
Nov 08 22:04:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-0381e930-7c97-444c-b8f6-25f438bc4d35 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.765s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epbVhXWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:04:45 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:04:45 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:04:45 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eac3d8-690c-418f-bf57-5add27241dcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:04:45 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3718aefa-7ae7-44ec-8b44-d243cb08ed80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c] added
Nov 08 22:04:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a806dc-2359-4364-bb9b-f4ff33ac7faa]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[611417bc-2337-45b3-886b-32833163ae51]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epbVhXWA {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v epbVhXWA" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb0f1db-acc8-4c46-9149-648ea98ef8c6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'epbVhXWA'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e15f1b-644b-4c31-97a6-21e3a465c16c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2786dd9a-0c86-49cf-b278-f2e634ec27a6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:04:45 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:04:45 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:04:45 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 22:04:45 user nova-compute[75993]: 
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0de164-d8be-49c1-979c-af4c24dbf512]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c, portal: 172.16.0.220,3260]
Nov 08 22:04:45 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c, portal: 172.16.0.220,3260] successful.
Nov 08 22:04:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac278d0f-7359-4d50-8856-5082723db026]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d162ce2b-a790-41db-bf32-f195526f3620]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c (non-flash)
Nov 08 22:04:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c (non-flash)
Nov 08 22:04:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe04660-5dc0-4f43-b70d-0636c3c6ca7c]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:04:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epbVhXWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:04:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:04:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23632326565343334', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:04:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632326565343334', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:04:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:04:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 22:04:46 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:04:46 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:04:46 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:04:46 user nova-compute[75993]:   <serial>858a797d-2e66-4332-96d3-a2431ec3ee3c</serial>
Nov 08 22:04:46 user nova-compute[75993]: </disk>
Nov 08 22:04:46 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 22:04:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:04:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:04:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No VIF found with MAC fa:16:3e:bb:b1:a2, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:04:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3e3227b9-8a35-46be-9279-e58c15cf34cb tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.324s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:04:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:04:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:04:50 user nova-compute[75993]: INFO nova.compute.manager [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Detaching volume 858a797d-2e66-4332-96d3-a2431ec3ee3c
Nov 08 22:04:50 user nova-compute[75993]: INFO nova.virt.block_device [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attempting to driver detach volume 858a797d-2e66-4332-96d3-a2431ec3ee3c from mountpoint /dev/vdb
Nov 08 22:04:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Attempting to detach device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 22:04:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:04:50 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:04:50 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:04:50 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:04:50 user nova-compute[75993]:   <serial>858a797d-2e66-4332-96d3-a2431ec3ee3c</serial>
Nov 08 22:04:50 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:04:50 user nova-compute[75993]: </disk>
Nov 08 22:04:50 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:04:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Successfully detached device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the persistent domain config.
Nov 08 22:04:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 22:04:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:04:50 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:04:50 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:04:50 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:04:50 user nova-compute[75993]:   <serial>858a797d-2e66-4332-96d3-a2431ec3ee3c</serial>
Nov 08 22:04:50 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:04:50 user nova-compute[75993]: </disk>
Nov 08 22:04:50 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:04:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 22:04:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:04:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:10 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 is timed out.
Nov 08 22:05:10 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Successfully detached device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the live domain config.
Nov 08 22:05:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'epbVhXWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:05:10 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b08749a-ec16-4006-ab7a-7984a8854e39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:05:10 user nova-compute[75993]: No targets found.
Nov 08 22:05:10 user nova-compute[75993]: iSNS:
Nov 08 22:05:10 user nova-compute[75993]: No targets found.
Nov 08 22:05:10 user nova-compute[75993]: STATIC:
Nov 08 22:05:10 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c
Nov 08 22:05:10 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:05:10 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:05:10 user nova-compute[75993]: FIRMWARE:
Nov 08 22:05:10 user nova-compute[75993]: No targets found.
Nov 08 22:05:10 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:05:10 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:05:10 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7f96a2-a342-403c-8107-9a39325fbcf3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fb18c7-5485-4046-9c71-348487ca84aa]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c (non-flash)
Nov 08 22:05:10 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c (non-flash)
Nov 08 22:05:10 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544b72440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e06b81d-9745-4470-b3f3-6b8aedb9f390]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda9221a-4d9c-4f71-9566-d871b43f6f06]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[32044f04-c435-4797-86aa-2eab61f4b1d0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c03520-f790-46d9-a60f-a698b2d9b0e7]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e10f9e-a1d4-476d-b55b-3513b8b3c5b3]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[910d4b87-458c-43af-926e-19edd3304427]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c, portal: 172.16.0.220,3260]
Nov 08 22:05:10 user nova-compute[75993]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c, portal: 172.16.0.220,3260] successful.
Nov 08 22:05:10 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:858a797d-2e66-4332-96d3-a2431ec3ee3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb62f9ea-9753-4393-91a5-f8f73e8f9a6d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== disconnect_volume: return (308ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:05:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:05:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:11 user nova-compute[75993]: DEBUG nova.objects.instance [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:05:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-ea51b177-2fb2-4281-9512-201a4086b2e1 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.976s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:05:12 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:12 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:14 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:05:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:05:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:05:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:05:14 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:05:14 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updating instance_info_cache with network_info: [{"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:16 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:05:16 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:05:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8498MB free_disk=25.052738189697266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:05:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:05:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9ca82207-c9df-4e5f-9eae-459397b1a414 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:20 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:05:22 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:22 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:22 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:05:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:05:28 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:28 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 22:05:28 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 22:05:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:05:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:05:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 22:05:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:05:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:05:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:05:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:05:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:05:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:05:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:05:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:05:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:05:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:05:46 user nova-compute[75993]: INFO nova.compute.manager [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attaching volume 181d26e8-987f-420b-b15a-32d1e9f9893e to /dev/vdb
Nov 08 22:05:46 user nova-compute[75993]: DEBUG os_brick.utils [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[11adcba3-4c9e-46c5-8dd5-3e326a044f7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1356835-ccc9-4a22-86b6-d20ba4ec7583]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d684b71-b3d2-4a48-bb2a-837a578427de]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f24c1c-5ec3-44e0-99b5-3d7e3f05c61a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:05:46 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:05:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[72091bb0-31cc-449f-b6c4-96e1abb91174]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG os_brick.utils [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updating existing volume attachment record: 60b8458f-bfa6-43ea-9ab5-767b00a51684 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:05:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:05:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:05:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:05:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:05:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:05:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:06:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDdqIPAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:06:09 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:06:09 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:06:09 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[83acd8cb-3032-4692-9a18-e5c347d60507]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:06:09 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbe3a8f-a027-4830-9de3-82914286312b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e] added
Nov 08 22:06:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded0720c-6a4b-4984-9d51-a8b6fdfa6584]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[593050b3-f806-4ff3-b862-e5c62187f3dd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hDdqIPAG {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hDdqIPAG" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1597f9-6f77-4591-8927-aa05c1b049b6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hDdqIPAG'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0651e7d-9888-4a54-9496-51d1d51310a5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ff6047-33ec-4636-a0d7-b2a1782077a5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:06:09 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:06:09 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:06:09 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 22:06:09 user nova-compute[75993]: 
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[352d6e94-2082-4324-9bcb-67d55d97e4eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e, portal: 172.16.0.220,3260]
Nov 08 22:06:09 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e, portal: 172.16.0.220,3260] successful.
Nov 08 22:06:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[730c990e-72ce-4c50-a9a9-2017cc305f40]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f49383-68f7-4ab9-9e33-2d7baf4a0d66]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e (non-flash)
Nov 08 22:06:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e (non-flash)
Nov 08 22:06:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b6e39a-f510-496b-a829-2610e0a3dce8]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:06:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDdqIPAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:06:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:06:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23530316336323662', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:06:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530316336323662', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:06:10 user nova-compute[75993]: DEBUG nova.objects.instance [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:06:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 22:06:10 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:06:10 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:06:10 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:06:10 user nova-compute[75993]:   <serial>181d26e8-987f-420b-b15a-32d1e9f9893e</serial>
Nov 08 22:06:10 user nova-compute[75993]: </disk>
Nov 08 22:06:10 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 22:06:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:06:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:06:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] No VIF found with MAC fa:16:3e:bb:b1:a2, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:06:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:06:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b7c71cf7-4b35-4249-84b9-b26cd6049158 tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.857s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:13 user nova-compute[75993]: INFO nova.compute.manager [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Detaching volume 181d26e8-987f-420b-b15a-32d1e9f9893e
Nov 08 22:06:13 user nova-compute[75993]: INFO nova.virt.block_device [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Attempting to driver detach volume 181d26e8-987f-420b-b15a-32d1e9f9893e from mountpoint /dev/vdb
Nov 08 22:06:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Attempting to detach device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 22:06:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:06:13 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:06:13 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:06:13 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:06:13 user nova-compute[75993]:   <serial>181d26e8-987f-420b-b15a-32d1e9f9893e</serial>
Nov 08 22:06:13 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:06:13 user nova-compute[75993]: </disk>
Nov 08 22:06:13 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:06:13 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Successfully detached device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the persistent domain config.
Nov 08 22:06:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 22:06:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:06:13 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:06:13 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:06:13 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:06:13 user nova-compute[75993]:   <serial>181d26e8-987f-420b-b15a-32d1e9f9893e</serial>
Nov 08 22:06:13 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:06:13 user nova-compute[75993]: </disk>
Nov 08 22:06:13 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:06:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 22:06:14 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:06:14 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:06:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:14 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:06:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:16 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:06:16 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:06:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8679MB free_disk=25.043285369873047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9ca82207-c9df-4e5f-9eae-459397b1a414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:06:17 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:06:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:06:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:06:17 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:06:17 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updating instance_info_cache with network_info: [{"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:06:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:06:17 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:06:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:06:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:06:19 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:06:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:22 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:06:22 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:06:22 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "075617f4-b953-4ecd-9740-7a438e58be1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "075617f4-b953-4ecd-9740-7a438e58be1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:06:23 user nova-compute[75993]: INFO nova.compute.claims [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Claim successful on node user
Nov 08 22:06:23 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG nova.network.neutron [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:06:23 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:06:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG nova.policy [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28f123ed5d424009a2de634bf8f5e287', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65fbb6d9c1ac42ddb05ca4a04e926c32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:06:23 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Creating image(s)
Nov 08 22:06:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "/opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "/opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "/opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.166s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk 1073741824" returned: 0 in 0.050s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.165s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Cannot resize image /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Ensure instance console log exists: /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-f8abdc46-5b4d-48a1-b885-99eba2549254 req-707d1a2d-9afa-479e-8a2b-fae30852def2 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-changed-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:06:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-f8abdc46-5b4d-48a1-b885-99eba2549254 req-707d1a2d-9afa-479e-8a2b-fae30852def2 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Refreshing instance network info cache due to event network-changed-bf9fae23-01fc-42f3-9702-31dcf3b7e62c. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f8abdc46-5b4d-48a1-b885-99eba2549254 req-707d1a2d-9afa-479e-8a2b-fae30852def2 service nova] Acquiring lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f8abdc46-5b4d-48a1-b885-99eba2549254 req-707d1a2d-9afa-479e-8a2b-fae30852def2 service nova] Acquired lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-f8abdc46-5b4d-48a1-b885-99eba2549254 req-707d1a2d-9afa-479e-8a2b-fae30852def2 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Refreshing network info cache for port bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG nova.network.neutron [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Successfully created port: 14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-f8abdc46-5b4d-48a1-b885-99eba2549254 req-707d1a2d-9afa-479e-8a2b-fae30852def2 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updated VIF entry in instance network info cache for port bf9fae23-01fc-42f3-9702-31dcf3b7e62c. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-f8abdc46-5b4d-48a1-b885-99eba2549254 req-707d1a2d-9afa-479e-8a2b-fae30852def2 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updating instance_info_cache with network_info: [{"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f8abdc46-5b4d-48a1-b885-99eba2549254 req-707d1a2d-9afa-479e-8a2b-fae30852def2 service nova] Releasing lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG nova.network.neutron [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Successfully updated port: 14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "refresh_cache-075617f4-b953-4ecd-9740-7a438e58be1c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquired lock "refresh_cache-075617f4-b953-4ecd-9740-7a438e58be1c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG nova.network.neutron [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:06:25 user nova-compute[75993]: DEBUG nova.network.neutron [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.network.neutron [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Updating instance_info_cache with network_info: [{"id": "14666faa-4c99-440a-a512-ee022fdb58de", "address": "fa:16:3e:bf:1e:02", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14666faa-4c", "ovs_interfaceid": "14666faa-4c99-440a-a512-ee022fdb58de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Releasing lock "refresh_cache-075617f4-b953-4ecd-9740-7a438e58be1c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Instance network_info: |[{"id": "14666faa-4c99-440a-a512-ee022fdb58de", "address": "fa:16:3e:bf:1e:02", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14666faa-4c", "ovs_interfaceid": "14666faa-4c99-440a-a512-ee022fdb58de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Start _get_guest_xml network_info=[{"id": "14666faa-4c99-440a-a512-ee022fdb58de", "address": "fa:16:3e:bf:1e:02", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14666faa-4c", "ovs_interfaceid": "14666faa-4c99-440a-a512-ee022fdb58de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:06:26 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:06:26 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-759854740',display_name='tempest-ServersNegativeTestJSON-server-759854740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-759854740',id=40,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65fbb6d9c1ac42ddb05ca4a04e926c32',ramdisk_id='',reservation_id='r-kwg1w3xe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1194338669',owner_user_name='tempest-ServersNegativeTestJSON-1194338669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:06:24Z,user_data=None,user_id='28f123ed5d424009a2de634bf8f5e287',uuid=075617f4-b953-4ecd-9740-7a438e58be1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14666faa-4c99-440a-a512-ee022fdb58de", "address": "fa:16:3e:bf:1e:02", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14666faa-4c", "ovs_interfaceid": "14666faa-4c99-440a-a512-ee022fdb58de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converting VIF {"id": "14666faa-4c99-440a-a512-ee022fdb58de", "address": "fa:16:3e:bf:1e:02", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14666faa-4c", "ovs_interfaceid": "14666faa-4c99-440a-a512-ee022fdb58de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:1e:02,bridge_name='br-int',has_traffic_filtering=True,id=14666faa-4c99-440a-a512-ee022fdb58de,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14666faa-4c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.objects.instance [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lazy-loading 'pci_devices' on Instance uuid 075617f4-b953-4ecd-9740-7a438e58be1c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:06:26 user nova-compute[75993]:   <uuid>075617f4-b953-4ecd-9740-7a438e58be1c</uuid>
Nov 08 22:06:26 user nova-compute[75993]:   <name>instance-00000028</name>
Nov 08 22:06:26 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:06:26 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:06:26 user nova-compute[75993]:   <metadata>
Nov 08 22:06:26 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:06:26 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:06:26 user nova-compute[75993]:       <nova:name>tempest-ServersNegativeTestJSON-server-759854740</nova:name>
Nov 08 22:06:26 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:06:26</nova:creationTime>
Nov 08 22:06:26 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:06:26 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:06:26 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:06:26 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:06:26 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:06:26 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:06:26 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:06:26 user nova-compute[75993]:       <nova:owner>
Nov 08 22:06:26 user nova-compute[75993]:         <nova:user uuid="28f123ed5d424009a2de634bf8f5e287">tempest-ServersNegativeTestJSON-1194338669-project-member</nova:user>
Nov 08 22:06:26 user nova-compute[75993]:         <nova:project uuid="65fbb6d9c1ac42ddb05ca4a04e926c32">tempest-ServersNegativeTestJSON-1194338669</nova:project>
Nov 08 22:06:26 user nova-compute[75993]:       </nova:owner>
Nov 08 22:06:26 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 22:06:26 user nova-compute[75993]:       <nova:ports>
Nov 08 22:06:26 user nova-compute[75993]:         <nova:port uuid="14666faa-4c99-440a-a512-ee022fdb58de">
Nov 08 22:06:26 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 22:06:26 user nova-compute[75993]:         </nova:port>
Nov 08 22:06:26 user nova-compute[75993]:       </nova:ports>
Nov 08 22:06:26 user nova-compute[75993]:     </nova:instance>
Nov 08 22:06:26 user nova-compute[75993]:   </metadata>
Nov 08 22:06:26 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:06:26 user nova-compute[75993]:     <system>
Nov 08 22:06:26 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:06:26 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:06:26 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:06:26 user nova-compute[75993]:       <entry name="serial">075617f4-b953-4ecd-9740-7a438e58be1c</entry>
Nov 08 22:06:26 user nova-compute[75993]:       <entry name="uuid">075617f4-b953-4ecd-9740-7a438e58be1c</entry>
Nov 08 22:06:26 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:06:26 user nova-compute[75993]:     </system>
Nov 08 22:06:26 user nova-compute[75993]:   </sysinfo>
Nov 08 22:06:26 user nova-compute[75993]:   <os>
Nov 08 22:06:26 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:06:26 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:06:26 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:06:26 user nova-compute[75993]:   </os>
Nov 08 22:06:26 user nova-compute[75993]:   <features>
Nov 08 22:06:26 user nova-compute[75993]:     <acpi/>
Nov 08 22:06:26 user nova-compute[75993]:     <apic/>
Nov 08 22:06:26 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:06:26 user nova-compute[75993]:   </features>
Nov 08 22:06:26 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:06:26 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:06:26 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:06:26 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:06:26 user nova-compute[75993]:   </clock>
Nov 08 22:06:26 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:06:26 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:06:26 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:06:26 user nova-compute[75993]:   </cpu>
Nov 08 22:06:26 user nova-compute[75993]:   <devices>
Nov 08 22:06:26 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 22:06:26 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 22:06:26 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk"/>
Nov 08 22:06:26 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:06:26 user nova-compute[75993]:     </disk>
Nov 08 22:06:26 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:06:26 user nova-compute[75993]:       <mac address="fa:16:3e:bf:1e:02"/>
Nov 08 22:06:26 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:06:26 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:06:26 user nova-compute[75993]:       <target dev="tap14666faa-4c"/>
Nov 08 22:06:26 user nova-compute[75993]:     </interface>
Nov 08 22:06:26 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:06:26 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/console.log" append="off"/>
Nov 08 22:06:26 user nova-compute[75993]:     </serial>
Nov 08 22:06:26 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:06:26 user nova-compute[75993]:     <video>
Nov 08 22:06:26 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:06:26 user nova-compute[75993]:     </video>
Nov 08 22:06:26 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:06:26 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:06:26 user nova-compute[75993]:     </rng>
Nov 08 22:06:26 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:06:26 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:06:26 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:06:26 user nova-compute[75993]:     </memballoon>
Nov 08 22:06:26 user nova-compute[75993]:   </devices>
Nov 08 22:06:26 user nova-compute[75993]: </domain>
Nov 08 22:06:26 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-759854740',display_name='tempest-ServersNegativeTestJSON-server-759854740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-759854740',id=40,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65fbb6d9c1ac42ddb05ca4a04e926c32',ramdisk_id='',reservation_id='r-kwg1w3xe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1194338669',owner_user_name='tempest-ServersNegativeTestJSON-1194338669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:06:24Z,user_data=None,user_id='28f123ed5d424009a2de634bf8f5e287',uuid=075617f4-b953-4ecd-9740-7a438e58be1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14666faa-4c99-440a-a512-ee022fdb58de", "address": "fa:16:3e:bf:1e:02", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14666faa-4c", "ovs_interfaceid": "14666faa-4c99-440a-a512-ee022fdb58de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converting VIF {"id": "14666faa-4c99-440a-a512-ee022fdb58de", "address": "fa:16:3e:bf:1e:02", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14666faa-4c", "ovs_interfaceid": "14666faa-4c99-440a-a512-ee022fdb58de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:1e:02,bridge_name='br-int',has_traffic_filtering=True,id=14666faa-4c99-440a-a512-ee022fdb58de,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14666faa-4c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG os_vif [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:1e:02,bridge_name='br-int',has_traffic_filtering=True,id=14666faa-4c99-440a-a512-ee022fdb58de,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14666faa-4c') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '838b74a7-9d58-5a69-9ca3-dccf99e08f83', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14666faa-4c, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14666faa-4c, col_values=(('qos', UUID('c08ec0e4-5496-424d-a6a9-5ac92f860294')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14666faa-4c, col_values=(('external_ids', {'iface-id': '14666faa-4c99-440a-a512-ee022fdb58de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:1e:02', 'vm-uuid': '075617f4-b953-4ecd-9740-7a438e58be1c'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:26 user nova-compute[75993]: INFO os_vif [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:1e:02,bridge_name='br-int',has_traffic_filtering=True,id=14666faa-4c99-440a-a512-ee022fdb58de,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14666faa-4c')
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] No VIF found with MAC fa:16:3e:bf:1e:02, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:06:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-bc8064f2-8fa9-4825-a6bd-208f8c600269 req-787c0f22-9dd6-4530-b8e2-7b94edba66da service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Received event network-changed-14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-bc8064f2-8fa9-4825-a6bd-208f8c600269 req-787c0f22-9dd6-4530-b8e2-7b94edba66da service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Refreshing instance network info cache due to event network-changed-14666faa-4c99-440a-a512-ee022fdb58de. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bc8064f2-8fa9-4825-a6bd-208f8c600269 req-787c0f22-9dd6-4530-b8e2-7b94edba66da service nova] Acquiring lock "refresh_cache-075617f4-b953-4ecd-9740-7a438e58be1c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bc8064f2-8fa9-4825-a6bd-208f8c600269 req-787c0f22-9dd6-4530-b8e2-7b94edba66da service nova] Acquired lock "refresh_cache-075617f4-b953-4ecd-9740-7a438e58be1c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG nova.network.neutron [req-bc8064f2-8fa9-4825-a6bd-208f8c600269 req-787c0f22-9dd6-4530-b8e2-7b94edba66da service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Refreshing network info cache for port 14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG nova.network.neutron [req-bc8064f2-8fa9-4825-a6bd-208f8c600269 req-787c0f22-9dd6-4530-b8e2-7b94edba66da service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Updated VIF entry in instance network info cache for port 14666faa-4c99-440a-a512-ee022fdb58de. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG nova.network.neutron [req-bc8064f2-8fa9-4825-a6bd-208f8c600269 req-787c0f22-9dd6-4530-b8e2-7b94edba66da service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Updating instance_info_cache with network_info: [{"id": "14666faa-4c99-440a-a512-ee022fdb58de", "address": "fa:16:3e:bf:1e:02", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14666faa-4c", "ovs_interfaceid": "14666faa-4c99-440a-a512-ee022fdb58de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bc8064f2-8fa9-4825-a6bd-208f8c600269 req-787c0f22-9dd6-4530-b8e2-7b94edba66da service nova] Releasing lock "refresh_cache-075617f4-b953-4ecd-9740-7a438e58be1c" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-da26cbf4-88bf-48af-b6c7-a55dc1edf93a req-5fd22f29-ce9f-4e98-8b1f-19badcab0b7c service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Received event network-vif-plugged-14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-da26cbf4-88bf-48af-b6c7-a55dc1edf93a req-5fd22f29-ce9f-4e98-8b1f-19badcab0b7c service nova] Acquiring lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-da26cbf4-88bf-48af-b6c7-a55dc1edf93a req-5fd22f29-ce9f-4e98-8b1f-19badcab0b7c service nova] Lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-da26cbf4-88bf-48af-b6c7-a55dc1edf93a req-5fd22f29-ce9f-4e98-8b1f-19badcab0b7c service nova] Lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-da26cbf4-88bf-48af-b6c7-a55dc1edf93a req-5fd22f29-ce9f-4e98-8b1f-19badcab0b7c service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] No waiting events found dispatching network-vif-plugged-14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:06:27 user nova-compute[75993]: WARNING nova.compute.manager [req-da26cbf4-88bf-48af-b6c7-a55dc1edf93a req-5fd22f29-ce9f-4e98-8b1f-19badcab0b7c service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Received unexpected event network-vif-plugged-14666faa-4c99-440a-a512-ee022fdb58de for instance with vm_state building and task_state spawning.
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.compute.manager [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:06:29 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Instance spawned successfully.
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:06:29 user nova-compute[75993]: INFO nova.compute.manager [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.compute.manager [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:06:29 user nova-compute[75993]: INFO nova.compute.manager [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Took 6.40 seconds to build instance.
Nov 08 22:06:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-73ce66e7-0eed-4c94-ae9a-f01f55d8de56 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "075617f4-b953-4ecd-9740-7a438e58be1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.499s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-6457ccda-b49c-4f42-a3c7-ce3f38763b41 req-66b9f054-f5c3-4294-828c-a6f2b53cb837 service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Received event network-vif-plugged-14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6457ccda-b49c-4f42-a3c7-ce3f38763b41 req-66b9f054-f5c3-4294-828c-a6f2b53cb837 service nova] Acquiring lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6457ccda-b49c-4f42-a3c7-ce3f38763b41 req-66b9f054-f5c3-4294-828c-a6f2b53cb837 service nova] Lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6457ccda-b49c-4f42-a3c7-ce3f38763b41 req-66b9f054-f5c3-4294-828c-a6f2b53cb837 service nova] Lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-6457ccda-b49c-4f42-a3c7-ce3f38763b41 req-66b9f054-f5c3-4294-828c-a6f2b53cb837 service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] No waiting events found dispatching network-vif-plugged-14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:06:29 user nova-compute[75993]: WARNING nova.compute.manager [req-6457ccda-b49c-4f42-a3c7-ce3f38763b41 req-66b9f054-f5c3-4294-828c-a6f2b53cb837 service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Received unexpected event network-vif-plugged-14666faa-4c99-440a-a512-ee022fdb58de for instance with vm_state active and task_state None.
Nov 08 22:06:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:31 user nova-compute[75993]: INFO nova.compute.manager [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Shelving
Nov 08 22:06:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-5ca167f7-90b7-4484-a581-437ff26279b8 req-15e001e2-0698-469f-8577-343f057bc5e5 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-unplugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:06:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5ca167f7-90b7-4484-a581-437ff26279b8 req-15e001e2-0698-469f-8577-343f057bc5e5 service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5ca167f7-90b7-4484-a581-437ff26279b8 req-15e001e2-0698-469f-8577-343f057bc5e5 service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5ca167f7-90b7-4484-a581-437ff26279b8 req-15e001e2-0698-469f-8577-343f057bc5e5 service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-5ca167f7-90b7-4484-a581-437ff26279b8 req-15e001e2-0698-469f-8577-343f057bc5e5 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-unplugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:06:32 user nova-compute[75993]: WARNING nova.compute.manager [req-5ca167f7-90b7-4484-a581-437ff26279b8 req-15e001e2-0698-469f-8577-343f057bc5e5 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received unexpected event network-vif-unplugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with vm_state active and task_state shelving.
Nov 08 22:06:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Instance destroyed successfully.
Nov 08 22:06:32 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Beginning cold snapshot process
Nov 08 22:06:32 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 22:06:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk /opt/stack/data/nova/instances/snapshots/tmpodko_jf9/12be78ffa6b24335b9392be2361be1ed {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:33 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk /opt/stack/data/nova/instances/snapshots/tmpodko_jf9/12be78ffa6b24335b9392be2361be1ed" returned: 0 in 0.588s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:33 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Snapshot extracted, beginning image upload
Nov 08 22:06:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-09d80ffd-5da6-4d4a-ad6e-c6f29de263a4 req-ed7fca4f-3bb1-476b-ad74-a1f81f4d155b service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-09d80ffd-5da6-4d4a-ad6e-c6f29de263a4 req-ed7fca4f-3bb1-476b-ad74-a1f81f4d155b service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-09d80ffd-5da6-4d4a-ad6e-c6f29de263a4 req-ed7fca4f-3bb1-476b-ad74-a1f81f4d155b service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-09d80ffd-5da6-4d4a-ad6e-c6f29de263a4 req-ed7fca4f-3bb1-476b-ad74-a1f81f4d155b service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG nova.compute.manager [req-09d80ffd-5da6-4d4a-ad6e-c6f29de263a4 req-ed7fca4f-3bb1-476b-ad74-a1f81f4d155b service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:06:34 user nova-compute[75993]: WARNING nova.compute.manager [req-09d80ffd-5da6-4d4a-ad6e-c6f29de263a4 req-ed7fca4f-3bb1-476b-ad74-a1f81f4d155b service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received unexpected event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 22:06:34 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 is timed out.
Nov 08 22:06:34 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Successfully detached device vdb from instance 9ca82207-c9df-4e5f-9eae-459397b1a414 from the live domain config.
Nov 08 22:06:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hDdqIPAG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:06:34 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[523695e5-b757-4269-ae65-fe624c7b8569]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:06:34 user nova-compute[75993]: No targets found.
Nov 08 22:06:34 user nova-compute[75993]: iSNS:
Nov 08 22:06:34 user nova-compute[75993]: No targets found.
Nov 08 22:06:34 user nova-compute[75993]: STATIC:
Nov 08 22:06:34 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e
Nov 08 22:06:34 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:06:34 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:06:34 user nova-compute[75993]: FIRMWARE:
Nov 08 22:06:34 user nova-compute[75993]: No targets found.
Nov 08 22:06:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:06:34 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:06:34 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b98daad-3b28-43e7-8e44-07084331ad18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[880da77a-f425-410a-b131-54c6cf32e9cc]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e (non-flash)
Nov 08 22:06:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e (non-flash)
Nov 08 22:06:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544ce9a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed86594-6a2d-4866-9518-93302f241559]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73c41c4-bcae-4028-b735-228c567afccb]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e55d43d-43df-4428-b801-6cd2ee103a87]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba096fd2-d6cf-40dc-8ac0-f64c797cd296]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da654a0-c08c-42f0-939b-d4bdcb259b05]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[086fc9b4-fb50-44f2-aedc-a5235a90ea17]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e, portal: 172.16.0.220,3260]
Nov 08 22:06:34 user nova-compute[75993]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e, portal: 172.16.0.220,3260] successful.
Nov 08 22:06:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:181d26e8-987f-420b-b15a-32d1e9f9893e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2aaa56-d6c9-43de-aea5-c3f7805cb96f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] <== disconnect_volume: return (289ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:06:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:06:35 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'flavor' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:06:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e19992c6-70af-4e10-a4b1-28a274e905bc tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.993s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:35 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Snapshot image upload complete
Nov 08 22:06:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:06:35 user nova-compute[75993]: INFO nova.compute.manager [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Shelve offloading
Nov 08 22:06:35 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Instance destroyed successfully.
Nov 08 22:06:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:06:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:06:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquired lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:06:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG nova.network.neutron [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updating instance_info_cache with network_info: [{"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Releasing lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:06:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Instance destroyed successfully.
Nov 08 22:06:36 user nova-compute[75993]: DEBUG nova.objects.instance [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'resources' on Instance uuid 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1163902224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1163902224',id=39,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/Q9bI9MR90o4Ahm70g4BIr1RNc+/EEReShm0yw+Tiw6vOii9fjJC0oNDuJ9ggGmvtmKXq/A4wcu62Aqk6G/yLPrmvb79FVhli9DXoQsXwPbFGi5MS7KXjdvPpGPabGxQ==',key_name='tempest-keypair-1346375788',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:04:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-380o1u8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member',shelved_at='2023-11-08T22:06:35.859197',shelved_host='user',shelved_image_id='8393700c-7ef9-4536-a333-d99fc249f6ad'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:06:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG os_vif [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-764007f8-af21-47e5-abab-456ca0384098 req-88f25d69-0818-45cc-a2b9-408f78b39c60 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-changed-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG nova.compute.manager [req-764007f8-af21-47e5-abab-456ca0384098 req-88f25d69-0818-45cc-a2b9-408f78b39c60 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Refreshing instance network info cache due to event network-changed-bf9fae23-01fc-42f3-9702-31dcf3b7e62c. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-764007f8-af21-47e5-abab-456ca0384098 req-88f25d69-0818-45cc-a2b9-408f78b39c60 service nova] Acquiring lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-764007f8-af21-47e5-abab-456ca0384098 req-88f25d69-0818-45cc-a2b9-408f78b39c60 service nova] Acquired lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG nova.network.neutron [req-764007f8-af21-47e5-abab-456ca0384098 req-88f25d69-0818-45cc-a2b9-408f78b39c60 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Refreshing network info cache for port bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf9fae23-01, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fee3d08f-e4fa-4888-bb0d-f0777fc01cc3) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:06:36 user nova-compute[75993]: INFO os_vif [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01')
Nov 08 22:06:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Deleting instance files /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad_del
Nov 08 22:06:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Deletion of /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad_del complete
Nov 08 22:06:37 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Deleted allocations for instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad
Nov 08 22:06:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:06:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:06:37 user nova-compute[75993]: DEBUG nova.objects.instance [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'numa_topology' on Instance uuid 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:06:37 user nova-compute[75993]: DEBUG nova.objects.base [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Object Instance<31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad> lazy-loaded attributes: resources,numa_topology {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:06:37 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:06:37 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:06:37 user nova-compute[75993]: DEBUG nova.network.neutron [req-764007f8-af21-47e5-abab-456ca0384098 req-88f25d69-0818-45cc-a2b9-408f78b39c60 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updated VIF entry in instance network info cache for port bf9fae23-01fc-42f3-9702-31dcf3b7e62c. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:06:37 user nova-compute[75993]: DEBUG nova.network.neutron [req-764007f8-af21-47e5-abab-456ca0384098 req-88f25d69-0818-45cc-a2b9-408f78b39c60 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updating instance_info_cache with network_info: [{"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbf9fae23-01", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:06:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-764007f8-af21-47e5-abab-456ca0384098 req-88f25d69-0818-45cc-a2b9-408f78b39c60 service nova] Releasing lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:06:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8401feee-99eb-4b84-aaa9-69e5800bbd22 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.784s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:06:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:06:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:07:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:07:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:07:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:07:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:07:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:07:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:07:16 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:07:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:07:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:07:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:07:16 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:07:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:07:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:07:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:07:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:07:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:07:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:07:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:07:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:07:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:07:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:07:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:07:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:07:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:07:18 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:07:18 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:07:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=24.992382049560547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:07:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:07:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:07:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9ca82207-c9df-4e5f-9eae-459397b1a414 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:07:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:07:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 075617f4-b953-4ecd-9740-7a438e58be1c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:07:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:07:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:07:18 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:07:18 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:07:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:07:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:07:20 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:07:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:07:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 08 22:07:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:07:20 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:07:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:07:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:07:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:23 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:07:23 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:07:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:07:25 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:07:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:07:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:07:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:07:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:07:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:07:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:07:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:07:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:07:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:07:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:08:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:08:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:08:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:08:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:08:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:08:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "075617f4-b953-4ecd-9740-7a438e58be1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "075617f4-b953-4ecd-9740-7a438e58be1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:13 user nova-compute[75993]: INFO nova.compute.manager [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Terminating instance
Nov 08 22:08:13 user nova-compute[75993]: DEBUG nova.compute.manager [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-f0b517e6-0778-43f5-a1b1-b15ddfe95896 req-ed9e96f1-bcfe-48a5-8f8f-264087cc8adf service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Received event network-vif-unplugged-14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f0b517e6-0778-43f5-a1b1-b15ddfe95896 req-ed9e96f1-bcfe-48a5-8f8f-264087cc8adf service nova] Acquiring lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f0b517e6-0778-43f5-a1b1-b15ddfe95896 req-ed9e96f1-bcfe-48a5-8f8f-264087cc8adf service nova] Lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f0b517e6-0778-43f5-a1b1-b15ddfe95896 req-ed9e96f1-bcfe-48a5-8f8f-264087cc8adf service nova] Lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-f0b517e6-0778-43f5-a1b1-b15ddfe95896 req-ed9e96f1-bcfe-48a5-8f8f-264087cc8adf service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] No waiting events found dispatching network-vif-unplugged-14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG nova.compute.manager [req-f0b517e6-0778-43f5-a1b1-b15ddfe95896 req-ed9e96f1-bcfe-48a5-8f8f-264087cc8adf service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Received event network-vif-unplugged-14666faa-4c99-440a-a512-ee022fdb58de for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:13 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Instance destroyed successfully.
Nov 08 22:08:13 user nova-compute[75993]: DEBUG nova.objects.instance [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lazy-loading 'resources' on Instance uuid 075617f4-b953-4ecd-9740-7a438e58be1c {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:06:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-759854740',display_name='tempest-ServersNegativeTestJSON-server-759854740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-759854740',id=40,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:06:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65fbb6d9c1ac42ddb05ca4a04e926c32',ramdisk_id='',reservation_id='r-kwg1w3xe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1194338669',owner_user_name='tempest-ServersNegativeTestJSON-1194338669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:06:30Z,user_data=None,user_id='28f123ed5d424009a2de634bf8f5e287',uuid=075617f4-b953-4ecd-9740-7a438e58be1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14666faa-4c99-440a-a512-ee022fdb58de", "address": "fa:16:3e:bf:1e:02", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14666faa-4c", "ovs_interfaceid": "14666faa-4c99-440a-a512-ee022fdb58de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converting VIF {"id": "14666faa-4c99-440a-a512-ee022fdb58de", "address": "fa:16:3e:bf:1e:02", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14666faa-4c", "ovs_interfaceid": "14666faa-4c99-440a-a512-ee022fdb58de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:1e:02,bridge_name='br-int',has_traffic_filtering=True,id=14666faa-4c99-440a-a512-ee022fdb58de,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14666faa-4c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG os_vif [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:1e:02,bridge_name='br-int',has_traffic_filtering=True,id=14666faa-4c99-440a-a512-ee022fdb58de,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14666faa-4c') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14666faa-4c, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c08ec0e4-5496-424d-a6a9-5ac92f860294) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:14 user nova-compute[75993]: INFO os_vif [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:1e:02,bridge_name='br-int',has_traffic_filtering=True,id=14666faa-4c99-440a-a512-ee022fdb58de,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14666faa-4c')
Nov 08 22:08:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Deleting instance files /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c_del
Nov 08 22:08:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Deletion of /opt/stack/data/nova/instances/075617f4-b953-4ecd-9740-7a438e58be1c_del complete
Nov 08 22:08:14 user nova-compute[75993]: INFO nova.compute.manager [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 08 22:08:14 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:08:14 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:08:14 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:08:14 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:08:14 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Took 0.42 seconds to deallocate network for instance.
Nov 08 22:08:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-15c4d668-8683-4ceb-af4a-fc1f1eb00691 req-b9e34812-778b-4297-927f-33dca6af1dec service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Received event network-vif-deleted-14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:08:14 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:08:14 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:08:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:14 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Deleted allocations for instance 075617f4-b953-4ecd-9740-7a438e58be1c
Nov 08 22:08:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30807c7f-78fc-402a-aa85-c5c89b565a21 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "075617f4-b953-4ecd-9740-7a438e58be1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.457s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:08:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-59c4c748-ff76-49cd-8251-aa4bb83a3f58 req-0aab7231-78f3-466b-9d42-909c022407e7 service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Received event network-vif-plugged-14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:08:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-59c4c748-ff76-49cd-8251-aa4bb83a3f58 req-0aab7231-78f3-466b-9d42-909c022407e7 service nova] Acquiring lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-59c4c748-ff76-49cd-8251-aa4bb83a3f58 req-0aab7231-78f3-466b-9d42-909c022407e7 service nova] Lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-59c4c748-ff76-49cd-8251-aa4bb83a3f58 req-0aab7231-78f3-466b-9d42-909c022407e7 service nova] Lock "075617f4-b953-4ecd-9740-7a438e58be1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-59c4c748-ff76-49cd-8251-aa4bb83a3f58 req-0aab7231-78f3-466b-9d42-909c022407e7 service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] No waiting events found dispatching network-vif-plugged-14666faa-4c99-440a-a512-ee022fdb58de {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:08:15 user nova-compute[75993]: WARNING nova.compute.manager [req-59c4c748-ff76-49cd-8251-aa4bb83a3f58 req-0aab7231-78f3-466b-9d42-909c022407e7 service nova] [instance: 075617f4-b953-4ecd-9740-7a438e58be1c] Received unexpected event network-vif-plugged-14666faa-4c99-440a-a512-ee022fdb58de for instance with vm_state deleted and task_state None.
Nov 08 22:08:16 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:08:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:08:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:08:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:17 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:17 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:08:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:17 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:18 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:08:18 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:08:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=25.019058227539062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 9ca82207-c9df-4e5f-9eae-459397b1a414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:08:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:19 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:08:19 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:08:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:20 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:08:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:08:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:08:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:08:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:08:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:08:20 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:08:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updating instance_info_cache with network_info: [{"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:08:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-9ca82207-c9df-4e5f-9eae-459397b1a414" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:08:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:08:21 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:08:23 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:08:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:23 user nova-compute[75993]: INFO nova.compute.manager [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Terminating instance
Nov 08 22:08:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:08:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-807b516f-6605-431c-a194-d50f135e370c req-072f2a94-6066-425e-98a9-1704693334d7 service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Received event network-vif-unplugged-5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-807b516f-6605-431c-a194-d50f135e370c req-072f2a94-6066-425e-98a9-1704693334d7 service nova] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-807b516f-6605-431c-a194-d50f135e370c req-072f2a94-6066-425e-98a9-1704693334d7 service nova] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-807b516f-6605-431c-a194-d50f135e370c req-072f2a94-6066-425e-98a9-1704693334d7 service nova] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-807b516f-6605-431c-a194-d50f135e370c req-072f2a94-6066-425e-98a9-1704693334d7 service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] No waiting events found dispatching network-vif-unplugged-5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-807b516f-6605-431c-a194-d50f135e370c req-072f2a94-6066-425e-98a9-1704693334d7 service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Received event network-vif-unplugged-5ab96f99-3763-404e-aceb-1b793e648422 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:24 user nova-compute[75993]: INFO nova.compute.manager [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Unshelving
Nov 08 22:08:24 user nova-compute[75993]: INFO nova.virt.block_device [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Booting with volume 5688b7a1-d74f-4790-b22c-75596e4e6801 at /dev/vdc
Nov 08 22:08:24 user nova-compute[75993]: DEBUG os_brick.utils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc214247-9cba-4720-903c-5f233c68bb0e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cb0f5a-ad3d-487d-bf11-7d3418456c27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4f1829-c678-499d-9e14-18a872a0ee69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[48258323-1665-433e-a619-2000532dca13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:08:24 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a64af4a-2be5-4a21-bf9a-7fa93506aed7]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG os_brick.utils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updating existing volume attachment record: e3b058ea-5399-4dca-8470-7c478a4ff2e8 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:08:24 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Instance destroyed successfully.
Nov 08 22:08:24 user nova-compute[75993]: DEBUG nova.objects.instance [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lazy-loading 'resources' on Instance uuid 9ca82207-c9df-4e5f-9eae-459397b1a414 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T21:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1921205564',display_name='tempest-SnapshotDataIntegrityTests-server-1921205564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1921205564',id=36,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwzI5gTZsbr7sPdrUXSj8v8qT90Xk6gqT27Cf7h59LArD8r8712Wm+GHRmtsDu6scqV9bX282k1iwYTgKwM7fLg+3bACmw7RezOjsOgCgCFLzlcMcNzBVAtDo11YDrj1A==',key_name='tempest-keypair-568980894',keypairs=<?>,launch_index=0,launched_at=2023-11-08T21:59:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e63286e9009742619d06722d00a6d99a',ramdisk_id='',reservation_id='r-rbjs6p2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1817277621',owner_user_name='tempest-SnapshotDataIntegrityTests-1817277621-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T21:59:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9d3162aaa4874fd98c3bd8a1732a5f9e',uuid=9ca82207-c9df-4e5f-9eae-459397b1a414,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Converting VIF {"id": "5ab96f99-3763-404e-aceb-1b793e648422", "address": "fa:16:3e:bb:b1:a2", "network": {"id": "7219949b-cb93-4aaf-b575-ad241aa95907", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-847202438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e63286e9009742619d06722d00a6d99a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ab96f99-37", "ovs_interfaceid": "5ab96f99-3763-404e-aceb-1b793e648422", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=5ab96f99-3763-404e-aceb-1b793e648422,network=Network(7219949b-cb93-4aaf-b575-ad241aa95907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab96f99-37') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG os_vif [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=5ab96f99-3763-404e-aceb-1b793e648422,network=Network(7219949b-cb93-4aaf-b575-ad241aa95907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab96f99-37') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ab96f99-37, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2634a697-ee66-4bba-a5d1-164681f015ba) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:08:24 user nova-compute[75993]: INFO os_vif [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:b1:a2,bridge_name='br-int',has_traffic_filtering=True,id=5ab96f99-3763-404e-aceb-1b793e648422,network=Network(7219949b-cb93-4aaf-b575-ad241aa95907),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ab96f99-37')
Nov 08 22:08:24 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Deleting instance files /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414_del
Nov 08 22:08:24 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Deletion of /opt/stack/data/nova/instances/9ca82207-c9df-4e5f-9eae-459397b1a414_del complete
Nov 08 22:08:24 user nova-compute[75993]: INFO nova.compute.manager [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 08 22:08:24 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:08:24 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:08:25 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:08:25 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Took 1.16 seconds to deallocate network for instance.
Nov 08 22:08:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:26 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:08:26 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:08:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:26 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Deleted allocations for instance 9ca82207-c9df-4e5f-9eae-459397b1a414
Nov 08 22:08:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-c155a489-ba9a-4d7e-9e9e-2e386e1d5d8f req-6a29445b-d56a-47f3-862e-d2b0143f1ab1 service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Received event network-vif-plugged-5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:08:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c155a489-ba9a-4d7e-9e9e-2e386e1d5d8f req-6a29445b-d56a-47f3-862e-d2b0143f1ab1 service nova] Acquiring lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c155a489-ba9a-4d7e-9e9e-2e386e1d5d8f req-6a29445b-d56a-47f3-862e-d2b0143f1ab1 service nova] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c155a489-ba9a-4d7e-9e9e-2e386e1d5d8f req-6a29445b-d56a-47f3-862e-d2b0143f1ab1 service nova] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-c155a489-ba9a-4d7e-9e9e-2e386e1d5d8f req-6a29445b-d56a-47f3-862e-d2b0143f1ab1 service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] No waiting events found dispatching network-vif-plugged-5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:08:26 user nova-compute[75993]: WARNING nova.compute.manager [req-c155a489-ba9a-4d7e-9e9e-2e386e1d5d8f req-6a29445b-d56a-47f3-862e-d2b0143f1ab1 service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Received unexpected event network-vif-plugged-5ab96f99-3763-404e-aceb-1b793e648422 for instance with vm_state deleted and task_state None.
Nov 08 22:08:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-c155a489-ba9a-4d7e-9e9e-2e386e1d5d8f req-6a29445b-d56a-47f3-862e-d2b0143f1ab1 service nova] [instance: 9ca82207-c9df-4e5f-9eae-459397b1a414] Received event network-vif-deleted-5ab96f99-3763-404e-aceb-1b793e648422 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:08:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b329551d-d578-49f5-93aa-2da21f92669e tempest-SnapshotDataIntegrityTests-1817277621 tempest-SnapshotDataIntegrityTests-1817277621-project-member] Lock "9ca82207-c9df-4e5f-9eae-459397b1a414" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.460s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:27 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:08:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:30 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:08:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:08:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:08:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:08:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:08:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:08:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:47 user nova-compute[75993]: DEBUG nova.objects.instance [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'pci_requests' on Instance uuid 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:08:47 user nova-compute[75993]: DEBUG nova.objects.instance [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'numa_topology' on Instance uuid 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:08:47 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:08:47 user nova-compute[75993]: INFO nova.compute.claims [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Claim successful on node user
Nov 08 22:08:47 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:08:47 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:08:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:47 user nova-compute[75993]: INFO nova.network.neutron [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updating port bf9fae23-01fc-42f3-9702-31dcf3b7e62c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquired lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-d83291c2-1c54-480a-8048-70e2c97e8ca7 req-3ec17f2b-b575-4f42-9d6b-b5ff58d4dd14 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-changed-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-d83291c2-1c54-480a-8048-70e2c97e8ca7 req-3ec17f2b-b575-4f42-9d6b-b5ff58d4dd14 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Refreshing instance network info cache due to event network-changed-bf9fae23-01fc-42f3-9702-31dcf3b7e62c. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d83291c2-1c54-480a-8048-70e2c97e8ca7 req-3ec17f2b-b575-4f42-9d6b-b5ff58d4dd14 service nova] Acquiring lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updating instance_info_cache with network_info: [{"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Releasing lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:08:48 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Creating image(s)
Nov 08 22:08:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "/opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "/opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "/opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG nova.objects.instance [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'trusted_certs' on Instance uuid 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d83291c2-1c54-480a-8048-70e2c97e8ca7 req-3ec17f2b-b575-4f42-9d6b-b5ff58d4dd14 service nova] Acquired lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG nova.network.neutron [req-d83291c2-1c54-480a-8048-70e2c97e8ca7 req-3ec17f2b-b575-4f42-9d6b-b5ff58d4dd14 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Refreshing network info cache for port bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG nova.objects.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Object Instance<31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "66f33f5f239852b6499e6b47fbca8281b9fd8467" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "66f33f5f239852b6499e6b47fbca8281b9fd8467" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467.part --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467.part --force-share --output=json" returned: 0 in 0.247s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:50 user nova-compute[75993]: DEBUG nova.virt.images [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] 8393700c-7ef9-4536-a333-d99fc249f6ad was qcow2, converting to raw {{(pid=75993) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 22:08:50 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 22:08:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467.part /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467.converted {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:50 user nova-compute[75993]: DEBUG nova.network.neutron [req-d83291c2-1c54-480a-8048-70e2c97e8ca7 req-3ec17f2b-b575-4f42-9d6b-b5ff58d4dd14 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updated VIF entry in instance network info cache for port bf9fae23-01fc-42f3-9702-31dcf3b7e62c. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:08:50 user nova-compute[75993]: DEBUG nova.network.neutron [req-d83291c2-1c54-480a-8048-70e2c97e8ca7 req-3ec17f2b-b575-4f42-9d6b-b5ff58d4dd14 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updating instance_info_cache with network_info: [{"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:08:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d83291c2-1c54-480a-8048-70e2c97e8ca7 req-3ec17f2b-b575-4f42-9d6b-b5ff58d4dd14 service nova] Releasing lock "refresh_cache-31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:08:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467.part /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467.converted" returned: 0 in 0.689s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467.converted --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467.converted --force-share --output=json" returned: 0 in 0.204s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "66f33f5f239852b6499e6b47fbca8281b9fd8467" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.202s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467 --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "66f33f5f239852b6499e6b47fbca8281b9fd8467" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "66f33f5f239852b6499e6b47fbca8281b9fd8467" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467 --force-share --output=json" returned: 0 in 0.173s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467,backing_fmt=raw /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467,backing_fmt=raw /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk 1073741824" returned: 0 in 0.047s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "66f33f5f239852b6499e6b47fbca8281b9fd8467" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467 --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467 --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG nova.objects.instance [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'migration_context' on Instance uuid 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG nova.objects.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Object Instance<31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:08:51 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Rebasing disk image.
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be -F raw /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be -F raw /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk" returned: 0 in 2.105s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Ensure instance console log exists: /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Start _get_guest_xml network_info=[{"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='5b8f4f90c0b633be87850b22c09324b1',container_format='bare',created_at=2023-11-08T22:06:32Z,direct_url=<?>,disk_format='qcow2',id=8393700c-7ef9-4536-a333-d99fc249f6ad,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1163902224-shelved',owner='cb7a28285c5c4db9aa84b223a2235839',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T22:06:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': None, 'attachment_id': 'e3b058ea-5399-4dca-8470-7c478a4ff2e8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGYQsMTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad', 'attached_at': '', 'detached_at': '', 'volume_id': '5688b7a1-d74f-4790-b22c-75596e4e6801', 'serial': '5688b7a1-d74f-4790-b22c-75596e4e6801'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:08:53 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:08:53 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5b8f4f90c0b633be87850b22c09324b1',container_format='bare',created_at=2023-11-08T22:06:32Z,direct_url=<?>,disk_format='qcow2',id=8393700c-7ef9-4536-a333-d99fc249f6ad,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1163902224-shelved',owner='cb7a28285c5c4db9aa84b223a2235839',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T22:06:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.objects.instance [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'vcpu_model' on Instance uuid 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:08:53 user nova-compute[75993]: DEBUG nova.objects.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Object Instance<31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGYQsMTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:08:54 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:08:54 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:08:54 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[136581ff-9f00-4ff6-816b-9a67744eccb0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:08:54 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a13826f-4bf7-4bb7-8932-052e74319515]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801] added
Nov 08 22:08:54 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2c10b1-438c-4d49-b147-476a26ed1f45]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d1aa4d-2fff-494f-b250-45b1c3cfd316]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGYQsMTz {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aGYQsMTz" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc39dc2-d3db-4cba-8fe0-03853008ea63]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aGYQsMTz'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.055s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[866481e7-fc37-489a-8af5-7fcd19b20d0b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f836173-42ed-4fa1-96f4-7df90e6a1b66]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:08:54 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:08:54 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:08:54 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 22:08:54 user nova-compute[75993]: 
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edc24a0-2f78-4a2a-b8cf-699d38391dae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801, portal: 172.16.0.220,3260]
Nov 08 22:08:54 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801, portal: 172.16.0.220,3260] successful.
Nov 08 22:08:54 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ba3771-a262-41e1-b664-2ea37d31c3bb]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a25fe8-d39d-4ced-8026-31927bd2e293]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 (non-flash)
Nov 08 22:08:54 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 (non-flash)
Nov 08 22:08:54 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ead7a4-7e6f-471b-bcea-8758b4e9c61f]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:08:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGYQsMTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23437616661363462', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437616661363462', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T22:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1163902224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1163902224',id=39,image_ref='8393700c-7ef9-4536-a333-d99fc249f6ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1346375788',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:04:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-380o1u8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member',shelved_at='2023-11-08T22:06:35.859197',shelved_host='user',shelved_image_id='8393700c-7ef9-4536-a333-d99fc249f6ad'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:08:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.objects.instance [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'pci_devices' on Instance uuid 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.objects.base [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Object Instance<31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:08:55 user nova-compute[75993]:   <uuid>31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad</uuid>
Nov 08 22:08:55 user nova-compute[75993]:   <name>instance-00000027</name>
Nov 08 22:08:55 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:08:55 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:08:55 user nova-compute[75993]:   <metadata>
Nov 08 22:08:55 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:08:55 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:08:55 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1163902224</nova:name>
Nov 08 22:08:55 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:08:53</nova:creationTime>
Nov 08 22:08:55 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:08:55 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:08:55 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:08:55 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:08:55 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:08:55 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:08:55 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:08:55 user nova-compute[75993]:       <nova:owner>
Nov 08 22:08:55 user nova-compute[75993]:         <nova:user uuid="2ddac60afc3b4fe9a9f85774fd1b8513">tempest-AttachVolumeShelveTestJSON-1533063344-project-member</nova:user>
Nov 08 22:08:55 user nova-compute[75993]:         <nova:project uuid="cb7a28285c5c4db9aa84b223a2235839">tempest-AttachVolumeShelveTestJSON-1533063344</nova:project>
Nov 08 22:08:55 user nova-compute[75993]:       </nova:owner>
Nov 08 22:08:55 user nova-compute[75993]:       <nova:root type="image" uuid="8393700c-7ef9-4536-a333-d99fc249f6ad"/>
Nov 08 22:08:55 user nova-compute[75993]:       <nova:ports>
Nov 08 22:08:55 user nova-compute[75993]:         <nova:port uuid="bf9fae23-01fc-42f3-9702-31dcf3b7e62c">
Nov 08 22:08:55 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 22:08:55 user nova-compute[75993]:         </nova:port>
Nov 08 22:08:55 user nova-compute[75993]:       </nova:ports>
Nov 08 22:08:55 user nova-compute[75993]:     </nova:instance>
Nov 08 22:08:55 user nova-compute[75993]:   </metadata>
Nov 08 22:08:55 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:08:55 user nova-compute[75993]:     <system>
Nov 08 22:08:55 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:08:55 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:08:55 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:08:55 user nova-compute[75993]:       <entry name="serial">31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad</entry>
Nov 08 22:08:55 user nova-compute[75993]:       <entry name="uuid">31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad</entry>
Nov 08 22:08:55 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:08:55 user nova-compute[75993]:     </system>
Nov 08 22:08:55 user nova-compute[75993]:   </sysinfo>
Nov 08 22:08:55 user nova-compute[75993]:   <os>
Nov 08 22:08:55 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:08:55 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:08:55 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:08:55 user nova-compute[75993]:   </os>
Nov 08 22:08:55 user nova-compute[75993]:   <features>
Nov 08 22:08:55 user nova-compute[75993]:     <acpi/>
Nov 08 22:08:55 user nova-compute[75993]:     <apic/>
Nov 08 22:08:55 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:08:55 user nova-compute[75993]:   </features>
Nov 08 22:08:55 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:08:55 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:08:55 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:08:55 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:08:55 user nova-compute[75993]:   </clock>
Nov 08 22:08:55 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:08:55 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:08:55 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:08:55 user nova-compute[75993]:   </cpu>
Nov 08 22:08:55 user nova-compute[75993]:   <devices>
Nov 08 22:08:55 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 22:08:55 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 22:08:55 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk"/>
Nov 08 22:08:55 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:08:55 user nova-compute[75993]:     </disk>
Nov 08 22:08:55 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 22:08:55 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:08:55 user nova-compute[75993]:       <source dev="/dev/sdb"/>
Nov 08 22:08:55 user nova-compute[75993]:       <target dev="vdc" bus="virtio"/>
Nov 08 22:08:55 user nova-compute[75993]:       <serial>5688b7a1-d74f-4790-b22c-75596e4e6801</serial>
Nov 08 22:08:55 user nova-compute[75993]:     </disk>
Nov 08 22:08:55 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:08:55 user nova-compute[75993]:       <mac address="fa:16:3e:b1:b8:bf"/>
Nov 08 22:08:55 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:08:55 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:08:55 user nova-compute[75993]:       <target dev="tapbf9fae23-01"/>
Nov 08 22:08:55 user nova-compute[75993]:     </interface>
Nov 08 22:08:55 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:08:55 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/console.log" append="off"/>
Nov 08 22:08:55 user nova-compute[75993]:     </serial>
Nov 08 22:08:55 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:08:55 user nova-compute[75993]:     <video>
Nov 08 22:08:55 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:08:55 user nova-compute[75993]:     </video>
Nov 08 22:08:55 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:08:55 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:08:55 user nova-compute[75993]:     </rng>
Nov 08 22:08:55 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:08:55 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:08:55 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:08:55 user nova-compute[75993]:     </memballoon>
Nov 08 22:08:55 user nova-compute[75993]:   </devices>
Nov 08 22:08:55 user nova-compute[75993]: </domain>
Nov 08 22:08:55 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T22:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1163902224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1163902224',id=39,image_ref='8393700c-7ef9-4536-a333-d99fc249f6ad',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1346375788',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:04:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-380o1u8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member',shelved_at='2023-11-08T22:06:35.859197',shelved_host='user',shelved_image_id='8393700c-7ef9-4536-a333-d99fc249f6ad'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:08:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG os_vif [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd1e2027-d865-5ecb-be1a-b5ffa99ef0aa', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf9fae23-01, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf9fae23-01, col_values=(('qos', UUID('bc9ad3ab-6d0e-47b4-bdde-115f00049dce')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf9fae23-01, col_values=(('external_ids', {'iface-id': 'bf9fae23-01fc-42f3-9702-31dcf3b7e62c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:b8:bf', 'vm-uuid': '31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:55 user nova-compute[75993]: INFO os_vif [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01')
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:08:55 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] No VIF found with MAC fa:16:3e:b1:b8:bf, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:08:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-cbec52c5-6912-488e-b86b-7e480270bf3b req-ee0a698f-b7df-455f-b3e4-dfae07f6fe45 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:08:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cbec52c5-6912-488e-b86b-7e480270bf3b req-ee0a698f-b7df-455f-b3e4-dfae07f6fe45 service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cbec52c5-6912-488e-b86b-7e480270bf3b req-ee0a698f-b7df-455f-b3e4-dfae07f6fe45 service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cbec52c5-6912-488e-b86b-7e480270bf3b req-ee0a698f-b7df-455f-b3e4-dfae07f6fe45 service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-cbec52c5-6912-488e-b86b-7e480270bf3b req-ee0a698f-b7df-455f-b3e4-dfae07f6fe45 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:08:57 user nova-compute[75993]: WARNING nova.compute.manager [req-cbec52c5-6912-488e-b86b-7e480270bf3b req-ee0a698f-b7df-455f-b3e4-dfae07f6fe45 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received unexpected event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 22:08:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:08:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:08:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:08:59 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Instance spawned successfully.
Nov 08 22:08:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-1c560cfa-3b93-4da4-844a-ff4ea092c9fe req-db35f582-b9bc-4fc8-92fd-d533e9842001 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:08:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1c560cfa-3b93-4da4-844a-ff4ea092c9fe req-db35f582-b9bc-4fc8-92fd-d533e9842001 service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:08:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1c560cfa-3b93-4da4-844a-ff4ea092c9fe req-db35f582-b9bc-4fc8-92fd-d533e9842001 service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:08:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1c560cfa-3b93-4da4-844a-ff4ea092c9fe req-db35f582-b9bc-4fc8-92fd-d533e9842001 service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:08:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-1c560cfa-3b93-4da4-844a-ff4ea092c9fe req-db35f582-b9bc-4fc8-92fd-d533e9842001 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:08:59 user nova-compute[75993]: WARNING nova.compute.manager [req-1c560cfa-3b93-4da4-844a-ff4ea092c9fe req-db35f582-b9bc-4fc8-92fd-d533e9842001 service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received unexpected event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 22:08:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:08:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-087c8c3d-62e7-4c5d-bd57-b1345ada05cf tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 35.256s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:09:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:16 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:09:16 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:09:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:18 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:09:19 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:09:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:09:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:09:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:09:19 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updating instance_info_cache with network_info: [{"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:09:20 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:09:21 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:09:21 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:09:21 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8691MB free_disk=25.01988983154297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:09:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:09:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:09:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:09:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:25 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:09:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:09:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:27 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:09:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Verify base images {{(pid=75993) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Image id 6094807b-c5f6-4b2a-ac9a-5175832ce24b yields fingerprint 3eed4b5833827bbf000990115cb9d379acdad6be {{(pid=75993) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 22:09:43 user nova-compute[75993]: INFO nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] image 6094807b-c5f6-4b2a-ac9a-5175832ce24b at (/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be): checking
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] image 6094807b-c5f6-4b2a-ac9a-5175832ce24b at (/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be): image is in use {{(pid=75993) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75993) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce is a valid instance name {{(pid=75993) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce has a disk file {{(pid=75993) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce is backed by 3eed4b5833827bbf000990115cb9d379acdad6be {{(pid=75993) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad is a valid instance name {{(pid=75993) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad has a disk file {{(pid=75993) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad is backed by 3eed4b5833827bbf000990115cb9d379acdad6be {{(pid=75993) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 08 22:09:43 user nova-compute[75993]: WARNING nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0
Nov 08 22:09:43 user nova-compute[75993]: WARNING nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34
Nov 08 22:09:43 user nova-compute[75993]: WARNING nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5
Nov 08 22:09:43 user nova-compute[75993]: WARNING nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467
Nov 08 22:09:43 user nova-compute[75993]: WARNING nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f
Nov 08 22:09:43 user nova-compute[75993]: WARNING nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b
Nov 08 22:09:43 user nova-compute[75993]: WARNING nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6
Nov 08 22:09:43 user nova-compute[75993]: WARNING nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Unknown base file: /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7
Nov 08 22:09:43 user nova-compute[75993]: INFO nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Active base files: /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be
Nov 08 22:09:43 user nova-compute[75993]: INFO nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Removable base files: /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0 /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34 /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5 /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467 /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6 /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7
Nov 08 22:09:43 user nova-compute[75993]: INFO nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ca3fe38bddc216173d7b6abbcd26c07fe260e8e0
Nov 08 22:09:43 user nova-compute[75993]: INFO nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e5f1662eb9fd846e3c05fe46c24129a991169d34
Nov 08 22:09:43 user nova-compute[75993]: INFO nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/790137ef2606763113e0887a0fb705ccfb97f0f5
Nov 08 22:09:43 user nova-compute[75993]: INFO nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/66f33f5f239852b6499e6b47fbca8281b9fd8467
Nov 08 22:09:43 user nova-compute[75993]: INFO nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f47e3dd579f74797b99d032927f3e4c796e47a4f
Nov 08 22:09:43 user nova-compute[75993]: INFO nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ee0d64456b8465d68052be7a5636715591e6ea5b
Nov 08 22:09:43 user nova-compute[75993]: INFO nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ea2fe87a11a6748e62bc8054f834b4a4083face6
Nov 08 22:09:43 user nova-compute[75993]: INFO nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4efdf792ad4b2cb1bebcab9025476948969ef1d7
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Verification complete {{(pid=75993) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Verify swap images {{(pid=75993) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 08 22:09:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.imagecache [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Verify ephemeral images {{(pid=75993) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 08 22:09:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:09:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:09:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:09:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:09:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:09:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:09:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:09:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:10:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:10:14 user nova-compute[75993]: INFO nova.compute.manager [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Detaching volume 5688b7a1-d74f-4790-b22c-75596e4e6801
Nov 08 22:10:14 user nova-compute[75993]: INFO nova.virt.block_device [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Attempting to driver detach volume 5688b7a1-d74f-4790-b22c-75596e4e6801 from mountpoint /dev/vdc
Nov 08 22:10:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Attempting to detach device vdc from instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 22:10:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:10:14 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:10:14 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:10:14 user nova-compute[75993]:   <target dev="vdc" bus="virtio"/>
Nov 08 22:10:14 user nova-compute[75993]:   <serial>5688b7a1-d74f-4790-b22c-75596e4e6801</serial>
Nov 08 22:10:14 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 22:10:14 user nova-compute[75993]: </disk>
Nov 08 22:10:14 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:10:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Successfully detached device vdc from instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad from the persistent domain config.
Nov 08 22:10:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 22:10:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:10:14 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:10:14 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:10:14 user nova-compute[75993]:   <target dev="vdc" bus="virtio"/>
Nov 08 22:10:14 user nova-compute[75993]:   <serial>5688b7a1-d74f-4790-b22c-75596e4e6801</serial>
Nov 08 22:10:14 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 08 22:10:14 user nova-compute[75993]: </disk>
Nov 08 22:10:14 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:10:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 22:10:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:18 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:19 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:10:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:10:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:10:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:10:19 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:10:19 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:10:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updating instance_info_cache with network_info: [{"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:10:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:10:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:10:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:21 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:21 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:10:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:10:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:10:21 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:10:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:22 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:10:22 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:10:22 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.01882553100586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:10:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:10:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:10:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.463s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:10:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:25 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:26 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:10:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 22:10:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:34 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad is timed out.
Nov 08 22:10:34 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Successfully detached device vdc from instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad from the live domain config.
Nov 08 22:10:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aGYQsMTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:10:34 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:10:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8badefe-1492-4853-a61c-85d09359fe2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:10:34 user nova-compute[75993]: No targets found.
Nov 08 22:10:34 user nova-compute[75993]: iSNS:
Nov 08 22:10:34 user nova-compute[75993]: No targets found.
Nov 08 22:10:34 user nova-compute[75993]: STATIC:
Nov 08 22:10:34 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801
Nov 08 22:10:34 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:10:34 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:10:34 user nova-compute[75993]: FIRMWARE:
Nov 08 22:10:34 user nova-compute[75993]: No targets found.
Nov 08 22:10:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:10:34 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:10:34 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[223b1b46-43f3-4a78-9967-fd8f097bc1f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fb34cf-bcc0-44f7-9b59-1418719fd609]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 (non-flash)
Nov 08 22:10:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 (non-flash)
Nov 08 22:10:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f858c4cbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[429380cc-fe68-474e-85b7-10e60f63d68c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:10:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cdfd2f-067d-42f1-8052-0efd40160f76]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[817ed1a6-f935-49db-b28c-fad1a0664ddd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[34253db1-f453-4132-87a9-ceba9e1d0c80]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e62643-aa73-41ae-ab7b-e775bc0c7ea4]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e831629-86fc-460f-af80-d9933bfc76fd]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801, portal: 172.16.0.220,3260]
Nov 08 22:10:35 user nova-compute[75993]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801, portal: 172.16.0.220,3260] successful.
Nov 08 22:10:35 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5688b7a1-d74f-4790-b22c-75596e4e6801 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e216eae-13ee-414a-bc91-cf22d9f660b7]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] <== disconnect_volume: return (273ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:10:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:36 user nova-compute[75993]: DEBUG nova.objects.instance [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'flavor' on Instance uuid 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:10:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-52950e3e-f159-4741-a811-d6048ca6e6ca tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.852s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:10:39 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:10:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 22:10:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:10:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:10:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:10:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:10:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:10:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:10:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:04 user nova-compute[75993]: INFO nova.compute.manager [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Terminating instance
Nov 08 22:11:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG nova.compute.manager [req-4df4b255-5c4a-4fdb-a24d-57c1710d6b67 req-1e43f11d-d82a-4274-a30d-acd165553e2d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-unplugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4df4b255-5c4a-4fdb-a24d-57c1710d6b67 req-1e43f11d-d82a-4274-a30d-acd165553e2d service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4df4b255-5c4a-4fdb-a24d-57c1710d6b67 req-1e43f11d-d82a-4274-a30d-acd165553e2d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4df4b255-5c4a-4fdb-a24d-57c1710d6b67 req-1e43f11d-d82a-4274-a30d-acd165553e2d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG nova.compute.manager [req-4df4b255-5c4a-4fdb-a24d-57c1710d6b67 req-1e43f11d-d82a-4274-a30d-acd165553e2d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-unplugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:11:04 user nova-compute[75993]: DEBUG nova.compute.manager [req-4df4b255-5c4a-4fdb-a24d-57c1710d6b67 req-1e43f11d-d82a-4274-a30d-acd165553e2d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-unplugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Instance destroyed successfully.
Nov 08 22:11:05 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'resources' on Instance uuid 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T22:04:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1163902224',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1163902224',id=39,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/Q9bI9MR90o4Ahm70g4BIr1RNc+/EEReShm0yw+Tiw6vOii9fjJC0oNDuJ9ggGmvtmKXq/A4wcu62Aqk6G/yLPrmvb79FVhli9DXoQsXwPbFGi5MS7KXjdvPpGPabGxQ==',key_name='tempest-keypair-1346375788',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-380o1u8t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "address": "fa:16:3e:b1:b8:bf", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.242", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf9fae23-01", "ovs_interfaceid": "bf9fae23-01fc-42f3-9702-31dcf3b7e62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG os_vif [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf9fae23-01, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc9ad3ab-6d0e-47b4-bdde-115f00049dce) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: INFO os_vif [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:b8:bf,bridge_name='br-int',has_traffic_filtering=True,id=bf9fae23-01fc-42f3-9702-31dcf3b7e62c,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf9fae23-01')
Nov 08 22:11:05 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Deleting instance files /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad_del
Nov 08 22:11:05 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Deletion of /opt/stack/data/nova/instances/31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad_del complete
Nov 08 22:11:05 user nova-compute[75993]: INFO nova.compute.manager [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 22:11:05 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:11:06 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Took 1.15 seconds to deallocate network for instance.
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:06 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Deleted allocations for instance 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:11:06 user nova-compute[75993]: WARNING nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received unexpected event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with vm_state deleted and task_state None.
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:11:06 user nova-compute[75993]: WARNING nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received unexpected event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with vm_state deleted and task_state None.
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:11:06 user nova-compute[75993]: WARNING nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received unexpected event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with vm_state deleted and task_state None.
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-unplugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-unplugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:11:06 user nova-compute[75993]: WARNING nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received unexpected event network-vif-unplugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with vm_state deleted and task_state None.
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Acquiring lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] No waiting events found dispatching network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:11:06 user nova-compute[75993]: WARNING nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received unexpected event network-vif-plugged-bf9fae23-01fc-42f3-9702-31dcf3b7e62c for instance with vm_state deleted and task_state None.
Nov 08 22:11:06 user nova-compute[75993]: DEBUG nova.compute.manager [req-3cd2c741-8ebd-4101-b5bc-df80edb16692 req-fa8ec1af-71b2-42db-a5d3-daedeebf849d service nova] [instance: 31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad] Received event network-vif-deleted-bf9fae23-01fc-42f3-9702-31dcf3b7e62c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:11:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c22f6c5-b536-4b4a-bf2c-24c7fe5f5f6d tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "31c8e9d5-9b63-4fe3-8eb9-4ee3c5ad81ad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.366s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:07 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:11:07 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:11:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:17 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:11:19 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:11:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:11:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:11:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:11:20 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:11:22 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:11:23 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:11:23 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:11:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:23 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:11:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:11:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:11:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:11:23 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:11:24 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:11:24 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:11:24 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8910MB free_disk=25.045989990234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:11:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:24 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:11:24 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:11:24 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:11:24 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:11:24 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:11:24 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:11:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:27 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:11:28 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:11:28 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:11:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:11:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:11:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:11:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "28e74bf5-96eb-4251-a597-2795cd352874" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:11:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:58 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:11:58 user nova-compute[75993]: INFO nova.compute.claims [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Claim successful on node user
Nov 08 22:11:59 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:11:59 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:11:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG nova.policy [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ddac60afc3b4fe9a9f85774fd1b8513', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7a28285c5c4db9aa84b223a2235839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:11:59 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Creating image(s)
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "/opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "/opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "/opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.188s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk 1073741824" returned: 0 in 0.047s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Successfully created port: 6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 22:11:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Cannot resize image /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Ensure instance console log exists: /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Successfully updated port: 6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquired lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-c5cf8356-63fe-48e3-834a-165344ea1568 req-620f4fb4-c5de-482c-ae25-f625af589227 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-changed-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-c5cf8356-63fe-48e3-834a-165344ea1568 req-620f4fb4-c5de-482c-ae25-f625af589227 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Refreshing instance network info cache due to event network-changed-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c5cf8356-63fe-48e3-834a-165344ea1568 req-620f4fb4-c5de-482c-ae25-f625af589227 service nova] Acquiring lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating instance_info_cache with network_info: [{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Releasing lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Instance network_info: |[{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c5cf8356-63fe-48e3-834a-165344ea1568 req-620f4fb4-c5de-482c-ae25-f625af589227 service nova] Acquired lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.network.neutron [req-c5cf8356-63fe-48e3-834a-165344ea1568 req-620f4fb4-c5de-482c-ae25-f625af589227 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Refreshing network info cache for port 6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Start _get_guest_xml network_info=[{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:12:00 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:12:00 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1763570869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1763570869',id=41,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH68muvupe3C41ngkmkwiUrPZ08dTr6lOQnVcgf0qPBLWIBpTqKWdnIbGZnFePGEfYChIOzHxeFWB59utxOADzliTBqmBZpF3YB92Dh7I/D2dkegz4H5LeHSAg3zy1g7KQ==',key_name='tempest-keypair-304529612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-ab5vtu9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:11:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=28e74bf5-96eb-4251-a597-2795cd352874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:12:00 user nova-compute[75993]: DEBUG nova.objects.instance [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'pci_devices' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:12:01 user nova-compute[75993]:   <uuid>28e74bf5-96eb-4251-a597-2795cd352874</uuid>
Nov 08 22:12:01 user nova-compute[75993]:   <name>instance-00000029</name>
Nov 08 22:12:01 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:12:01 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:12:01 user nova-compute[75993]:   <metadata>
Nov 08 22:12:01 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:12:01 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:12:01 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1763570869</nova:name>
Nov 08 22:12:01 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:12:00</nova:creationTime>
Nov 08 22:12:01 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:12:01 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:12:01 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:12:01 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:12:01 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:12:01 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:12:01 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:12:01 user nova-compute[75993]:       <nova:owner>
Nov 08 22:12:01 user nova-compute[75993]:         <nova:user uuid="2ddac60afc3b4fe9a9f85774fd1b8513">tempest-AttachVolumeShelveTestJSON-1533063344-project-member</nova:user>
Nov 08 22:12:01 user nova-compute[75993]:         <nova:project uuid="cb7a28285c5c4db9aa84b223a2235839">tempest-AttachVolumeShelveTestJSON-1533063344</nova:project>
Nov 08 22:12:01 user nova-compute[75993]:       </nova:owner>
Nov 08 22:12:01 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 22:12:01 user nova-compute[75993]:       <nova:ports>
Nov 08 22:12:01 user nova-compute[75993]:         <nova:port uuid="6e4eeabe-bca9-410f-b00a-c4d8b8c876f8">
Nov 08 22:12:01 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 22:12:01 user nova-compute[75993]:         </nova:port>
Nov 08 22:12:01 user nova-compute[75993]:       </nova:ports>
Nov 08 22:12:01 user nova-compute[75993]:     </nova:instance>
Nov 08 22:12:01 user nova-compute[75993]:   </metadata>
Nov 08 22:12:01 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:12:01 user nova-compute[75993]:     <system>
Nov 08 22:12:01 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:12:01 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:12:01 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:12:01 user nova-compute[75993]:       <entry name="serial">28e74bf5-96eb-4251-a597-2795cd352874</entry>
Nov 08 22:12:01 user nova-compute[75993]:       <entry name="uuid">28e74bf5-96eb-4251-a597-2795cd352874</entry>
Nov 08 22:12:01 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:12:01 user nova-compute[75993]:     </system>
Nov 08 22:12:01 user nova-compute[75993]:   </sysinfo>
Nov 08 22:12:01 user nova-compute[75993]:   <os>
Nov 08 22:12:01 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:12:01 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:12:01 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:12:01 user nova-compute[75993]:   </os>
Nov 08 22:12:01 user nova-compute[75993]:   <features>
Nov 08 22:12:01 user nova-compute[75993]:     <acpi/>
Nov 08 22:12:01 user nova-compute[75993]:     <apic/>
Nov 08 22:12:01 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:12:01 user nova-compute[75993]:   </features>
Nov 08 22:12:01 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:12:01 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:12:01 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:12:01 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:12:01 user nova-compute[75993]:   </clock>
Nov 08 22:12:01 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:12:01 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:12:01 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:12:01 user nova-compute[75993]:   </cpu>
Nov 08 22:12:01 user nova-compute[75993]:   <devices>
Nov 08 22:12:01 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 22:12:01 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 22:12:01 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk"/>
Nov 08 22:12:01 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:12:01 user nova-compute[75993]:     </disk>
Nov 08 22:12:01 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:12:01 user nova-compute[75993]:       <mac address="fa:16:3e:87:30:07"/>
Nov 08 22:12:01 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:12:01 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:12:01 user nova-compute[75993]:       <target dev="tap6e4eeabe-bc"/>
Nov 08 22:12:01 user nova-compute[75993]:     </interface>
Nov 08 22:12:01 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:12:01 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/console.log" append="off"/>
Nov 08 22:12:01 user nova-compute[75993]:     </serial>
Nov 08 22:12:01 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:12:01 user nova-compute[75993]:     <video>
Nov 08 22:12:01 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:12:01 user nova-compute[75993]:     </video>
Nov 08 22:12:01 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:12:01 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:12:01 user nova-compute[75993]:     </rng>
Nov 08 22:12:01 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:12:01 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:12:01 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:12:01 user nova-compute[75993]:     </memballoon>
Nov 08 22:12:01 user nova-compute[75993]:   </devices>
Nov 08 22:12:01 user nova-compute[75993]: </domain>
Nov 08 22:12:01 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1763570869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1763570869',id=41,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH68muvupe3C41ngkmkwiUrPZ08dTr6lOQnVcgf0qPBLWIBpTqKWdnIbGZnFePGEfYChIOzHxeFWB59utxOADzliTBqmBZpF3YB92Dh7I/D2dkegz4H5LeHSAg3zy1g7KQ==',key_name='tempest-keypair-304529612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-ab5vtu9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:11:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=28e74bf5-96eb-4251-a597-2795cd352874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG os_vif [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e13538c-3016-538f-9b61-b8fa61be1062', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e4eeabe-bc, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e4eeabe-bc, col_values=(('qos', UUID('1613ac0d-a619-4c89-a531-164647a246b7')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e4eeabe-bc, col_values=(('external_ids', {'iface-id': '6e4eeabe-bca9-410f-b00a-c4d8b8c876f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:30:07', 'vm-uuid': '28e74bf5-96eb-4251-a597-2795cd352874'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:01 user nova-compute[75993]: INFO os_vif [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc')
Nov 08 22:12:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] No VIF found with MAC fa:16:3e:87:30:07, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG nova.network.neutron [req-c5cf8356-63fe-48e3-834a-165344ea1568 req-620f4fb4-c5de-482c-ae25-f625af589227 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updated VIF entry in instance network info cache for port 6e4eeabe-bca9-410f-b00a-c4d8b8c876f8. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG nova.network.neutron [req-c5cf8356-63fe-48e3-834a-165344ea1568 req-620f4fb4-c5de-482c-ae25-f625af589227 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating instance_info_cache with network_info: [{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:12:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c5cf8356-63fe-48e3-834a-165344ea1568 req-620f4fb4-c5de-482c-ae25-f625af589227 service nova] Releasing lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:12:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-1fd3bcda-4730-49d3-a1cf-293c57a4689e req-9807410a-c690-46df-b1d8-9e8d68f48412 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:12:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1fd3bcda-4730-49d3-a1cf-293c57a4689e req-9807410a-c690-46df-b1d8-9e8d68f48412 service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:12:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1fd3bcda-4730-49d3-a1cf-293c57a4689e req-9807410a-c690-46df-b1d8-9e8d68f48412 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:12:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1fd3bcda-4730-49d3-a1cf-293c57a4689e req-9807410a-c690-46df-b1d8-9e8d68f48412 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:12:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-1fd3bcda-4730-49d3-a1cf-293c57a4689e req-9807410a-c690-46df-b1d8-9e8d68f48412 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:12:02 user nova-compute[75993]: WARNING nova.compute.manager [req-1fd3bcda-4730-49d3-a1cf-293c57a4689e req-9807410a-c690-46df-b1d8-9e8d68f48412 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received unexpected event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with vm_state building and task_state spawning.
Nov 08 22:12:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:12:04 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Instance spawned successfully.
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:12:04 user nova-compute[75993]: INFO nova.compute.manager [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.compute.manager [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.compute.manager [req-3dab31cc-7d4c-4e95-959b-2d39fc78b522 req-63b39090-9624-431e-8fee-c6ec57270be8 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3dab31cc-7d4c-4e95-959b-2d39fc78b522 req-63b39090-9624-431e-8fee-c6ec57270be8 service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3dab31cc-7d4c-4e95-959b-2d39fc78b522 req-63b39090-9624-431e-8fee-c6ec57270be8 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3dab31cc-7d4c-4e95-959b-2d39fc78b522 req-63b39090-9624-431e-8fee-c6ec57270be8 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:12:04 user nova-compute[75993]: DEBUG nova.compute.manager [req-3dab31cc-7d4c-4e95-959b-2d39fc78b522 req-63b39090-9624-431e-8fee-c6ec57270be8 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:12:04 user nova-compute[75993]: WARNING nova.compute.manager [req-3dab31cc-7d4c-4e95-959b-2d39fc78b522 req-63b39090-9624-431e-8fee-c6ec57270be8 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received unexpected event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with vm_state active and task_state None.
Nov 08 22:12:04 user nova-compute[75993]: INFO nova.compute.manager [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Took 5.74 seconds to build instance.
Nov 08 22:12:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-d5c37a10-6c45-4eb6-bae7-4ad33f28bd45 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "28e74bf5-96eb-4251-a597-2795cd352874" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.842s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:12:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:18 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:12:19 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:12:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:12:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:12:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:12:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:12:19 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:12:19 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:12:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updating instance_info_cache with network_info: [{"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:12:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:12:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:12:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:21 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:12:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:23 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:12:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:12:25 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:12:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:12:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:12:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:12:25 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:12:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:12:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:12:25 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:12:26 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:12:26 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:12:26 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=25.00961685180664GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 28e74bf5-96eb-4251-a597-2795cd352874 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:12:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:12:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:12:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:12:29 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:12:30 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:12:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:38 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:12:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:12:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:19 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:13:19 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:13:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:13:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:13:19 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:13:20 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating instance_info_cache with network_info: [{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:13:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:13:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:13:20 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:13:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:23 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:13:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:13:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:13:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:13:26 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:13:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:13:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:13:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:13:26 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:13:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:13:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:13:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:13:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:13:27 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:13:27 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:13:27 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8847MB free_disk=25.007648468017578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 28e74bf5-96eb-4251-a597-2795cd352874 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:13:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:13:30 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:13:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:13:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:13:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:13:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:13:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:13:39 user nova-compute[75993]: INFO nova.compute.manager [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Terminating instance
Nov 08 22:13:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-f3f66b48-44af-48e1-8773-c4024ea0627e req-373c85e1-3d9a-41c6-8c02-b2b7a887eb9e service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Received event network-vif-unplugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f3f66b48-44af-48e1-8773-c4024ea0627e req-373c85e1-3d9a-41c6-8c02-b2b7a887eb9e service nova] Acquiring lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f3f66b48-44af-48e1-8773-c4024ea0627e req-373c85e1-3d9a-41c6-8c02-b2b7a887eb9e service nova] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f3f66b48-44af-48e1-8773-c4024ea0627e req-373c85e1-3d9a-41c6-8c02-b2b7a887eb9e service nova] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-f3f66b48-44af-48e1-8773-c4024ea0627e req-373c85e1-3d9a-41c6-8c02-b2b7a887eb9e service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] No waiting events found dispatching network-vif-unplugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:13:39 user nova-compute[75993]: DEBUG nova.compute.manager [req-f3f66b48-44af-48e1-8773-c4024ea0627e req-373c85e1-3d9a-41c6-8c02-b2b7a887eb9e service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Received event network-vif-unplugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:40 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Instance destroyed successfully.
Nov 08 22:13:40 user nova-compute[75993]: DEBUG nova.objects.instance [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lazy-loading 'resources' on Instance uuid 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:04:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-512144214',display_name='tempest-ServersNegativeTestJSON-server-512144214',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-512144214',id=38,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:04:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65fbb6d9c1ac42ddb05ca4a04e926c32',ramdisk_id='',reservation_id='r-6017phm2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1194338669',owner_user_name='tempest-ServersNegativeTestJSON-1194338669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:04:40Z,user_data=None,user_id='28f123ed5d424009a2de634bf8f5e287',uuid=7fa742a1-5f77-4e70-ad1e-649c7a37a5ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converting VIF {"id": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "address": "fa:16:3e:e2:c2:5d", "network": {"id": "e91783c1-434e-49cc-9fa0-1c42e97322d5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-20685525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65fbb6d9c1ac42ddb05ca4a04e926c32", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap421d9dac-41", "ovs_interfaceid": "421d9dac-414a-47d7-ba54-a3e5158d6b9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:c2:5d,bridge_name='br-int',has_traffic_filtering=True,id=421d9dac-414a-47d7-ba54-a3e5158d6b9c,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap421d9dac-41') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG os_vif [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:c2:5d,bridge_name='br-int',has_traffic_filtering=True,id=421d9dac-414a-47d7-ba54-a3e5158d6b9c,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap421d9dac-41') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap421d9dac-41, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bf8fe23c-4888-4255-af26-4d77b2e8400f) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:13:40 user nova-compute[75993]: INFO os_vif [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:c2:5d,bridge_name='br-int',has_traffic_filtering=True,id=421d9dac-414a-47d7-ba54-a3e5158d6b9c,network=Network(e91783c1-434e-49cc-9fa0-1c42e97322d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap421d9dac-41')
Nov 08 22:13:40 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Deleting instance files /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce_del
Nov 08 22:13:40 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Deletion of /opt/stack/data/nova/instances/7fa742a1-5f77-4e70-ad1e-649c7a37a5ce_del complete
Nov 08 22:13:40 user nova-compute[75993]: INFO nova.compute.manager [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 08 22:13:40 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:13:40 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Took 0.47 seconds to deallocate network for instance.
Nov 08 22:13:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-5ad2c058-5770-47e2-b294-5e0b23ffcf53 req-74527964-c070-4a50-b2eb-66ea513d6245 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Received event network-vif-deleted-421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:13:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:13:41 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Deleted allocations for instance 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce
Nov 08 22:13:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-3c92b2f3-5241-4bd2-aa07-5ebc2ceef6f8 tempest-ServersNegativeTestJSON-1194338669 tempest-ServersNegativeTestJSON-1194338669-project-member] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.486s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:13:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-78720276-de8f-4476-8172-39ee75ec2f42 req-e1a870c8-fefa-49ec-bb59-115100cf4871 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Received event network-vif-plugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:13:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78720276-de8f-4476-8172-39ee75ec2f42 req-e1a870c8-fefa-49ec-bb59-115100cf4871 service nova] Acquiring lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:13:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78720276-de8f-4476-8172-39ee75ec2f42 req-e1a870c8-fefa-49ec-bb59-115100cf4871 service nova] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:13:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-78720276-de8f-4476-8172-39ee75ec2f42 req-e1a870c8-fefa-49ec-bb59-115100cf4871 service nova] Lock "7fa742a1-5f77-4e70-ad1e-649c7a37a5ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:13:41 user nova-compute[75993]: DEBUG nova.compute.manager [req-78720276-de8f-4476-8172-39ee75ec2f42 req-e1a870c8-fefa-49ec-bb59-115100cf4871 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] No waiting events found dispatching network-vif-plugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:13:41 user nova-compute[75993]: WARNING nova.compute.manager [req-78720276-de8f-4476-8172-39ee75ec2f42 req-e1a870c8-fefa-49ec-bb59-115100cf4871 service nova] [instance: 7fa742a1-5f77-4e70-ad1e-649c7a37a5ce] Received unexpected event network-vif-plugged-421d9dac-414a-47d7-ba54-a3e5158d6b9c for instance with vm_state deleted and task_state None.
Nov 08 22:13:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-9bf0f93d-ebe5-41c6-a748-64df8468316e req-195bdb15-2d42-45cb-b8e7-7dd3808255ad service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-changed-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:13:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-9bf0f93d-ebe5-41c6-a748-64df8468316e req-195bdb15-2d42-45cb-b8e7-7dd3808255ad service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Refreshing instance network info cache due to event network-changed-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:13:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9bf0f93d-ebe5-41c6-a748-64df8468316e req-195bdb15-2d42-45cb-b8e7-7dd3808255ad service nova] Acquiring lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:13:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9bf0f93d-ebe5-41c6-a748-64df8468316e req-195bdb15-2d42-45cb-b8e7-7dd3808255ad service nova] Acquired lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:13:49 user nova-compute[75993]: DEBUG nova.network.neutron [req-9bf0f93d-ebe5-41c6-a748-64df8468316e req-195bdb15-2d42-45cb-b8e7-7dd3808255ad service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Refreshing network info cache for port 6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:13:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:13:50 user nova-compute[75993]: DEBUG nova.network.neutron [req-9bf0f93d-ebe5-41c6-a748-64df8468316e req-195bdb15-2d42-45cb-b8e7-7dd3808255ad service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updated VIF entry in instance network info cache for port 6e4eeabe-bca9-410f-b00a-c4d8b8c876f8. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:13:50 user nova-compute[75993]: DEBUG nova.network.neutron [req-9bf0f93d-ebe5-41c6-a748-64df8468316e req-195bdb15-2d42-45cb-b8e7-7dd3808255ad service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating instance_info_cache with network_info: [{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:13:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-9bf0f93d-ebe5-41c6-a748-64df8468316e req-195bdb15-2d42-45cb-b8e7-7dd3808255ad service nova] Releasing lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:13:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:13:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "28e74bf5-96eb-4251-a597-2795cd352874" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:13:56 user nova-compute[75993]: INFO nova.compute.manager [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Shelving
Nov 08 22:13:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:13:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-4d349bcb-a2d5-4170-9b53-be002270161c req-366075b9-5d29-4007-9ed0-52a1a8ee907e service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-unplugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:13:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4d349bcb-a2d5-4170-9b53-be002270161c req-366075b9-5d29-4007-9ed0-52a1a8ee907e service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:13:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4d349bcb-a2d5-4170-9b53-be002270161c req-366075b9-5d29-4007-9ed0-52a1a8ee907e service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:13:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4d349bcb-a2d5-4170-9b53-be002270161c req-366075b9-5d29-4007-9ed0-52a1a8ee907e service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:13:57 user nova-compute[75993]: DEBUG nova.compute.manager [req-4d349bcb-a2d5-4170-9b53-be002270161c req-366075b9-5d29-4007-9ed0-52a1a8ee907e service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-unplugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:13:57 user nova-compute[75993]: WARNING nova.compute.manager [req-4d349bcb-a2d5-4170-9b53-be002270161c req-366075b9-5d29-4007-9ed0-52a1a8ee907e service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received unexpected event network-vif-unplugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with vm_state active and task_state shelving.
Nov 08 22:13:57 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Instance destroyed successfully.
Nov 08 22:13:57 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Beginning cold snapshot process
Nov 08 22:13:57 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 22:13:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk /opt/stack/data/nova/instances/snapshots/tmp_nd_b2yi/edb073bdc25c443ab6a92700bd54a31c {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:13:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk /opt/stack/data/nova/instances/snapshots/tmp_nd_b2yi/edb073bdc25c443ab6a92700bd54a31c" returned: 0 in 0.587s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:13:58 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Snapshot extracted, beginning image upload
Nov 08 22:13:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-1d236b0a-0682-4f60-8450-1724ccf74469 req-2717ebab-195d-4bd5-89c9-1e7d1ed485f0 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:13:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1d236b0a-0682-4f60-8450-1724ccf74469 req-2717ebab-195d-4bd5-89c9-1e7d1ed485f0 service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:13:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1d236b0a-0682-4f60-8450-1724ccf74469 req-2717ebab-195d-4bd5-89c9-1e7d1ed485f0 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:13:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1d236b0a-0682-4f60-8450-1724ccf74469 req-2717ebab-195d-4bd5-89c9-1e7d1ed485f0 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:13:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-1d236b0a-0682-4f60-8450-1724ccf74469 req-2717ebab-195d-4bd5-89c9-1e7d1ed485f0 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:13:59 user nova-compute[75993]: WARNING nova.compute.manager [req-1d236b0a-0682-4f60-8450-1724ccf74469 req-2717ebab-195d-4bd5-89c9-1e7d1ed485f0 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received unexpected event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with vm_state active and task_state shelving_image_uploading.
Nov 08 22:14:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:00 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Snapshot image upload complete
Nov 08 22:14:00 user nova-compute[75993]: DEBUG nova.compute.manager [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:14:00 user nova-compute[75993]: INFO nova.compute.manager [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Shelve offloading
Nov 08 22:14:00 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Instance destroyed successfully.
Nov 08 22:14:00 user nova-compute[75993]: DEBUG nova.compute.manager [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:14:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:14:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquired lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:14:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:14:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating instance_info_cache with network_info: [{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:14:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Releasing lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:14:01 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Instance destroyed successfully.
Nov 08 22:14:01 user nova-compute[75993]: DEBUG nova.objects.instance [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'resources' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1763570869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1763570869',id=41,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH68muvupe3C41ngkmkwiUrPZ08dTr6lOQnVcgf0qPBLWIBpTqKWdnIbGZnFePGEfYChIOzHxeFWB59utxOADzliTBqmBZpF3YB92Dh7I/D2dkegz4H5LeHSAg3zy1g7KQ==',key_name='tempest-keypair-304529612',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:12:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-ab5vtu9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member',shelved_at='2023-11-08T22:14:00.464665',shelved_host='user',shelved_image_id='7327590c-ce66-4c69-965f-ee80b80d5921'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:13:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=28e74bf5-96eb-4251-a597-2795cd352874,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG os_vif [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e4eeabe-bc, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-69f255a7-8eb4-452c-88ea-8bb05f4ba75e req-0e911b3c-322c-493a-a690-7f7e01c15071 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-changed-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-69f255a7-8eb4-452c-88ea-8bb05f4ba75e req-0e911b3c-322c-493a-a690-7f7e01c15071 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Refreshing instance network info cache due to event network-changed-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-69f255a7-8eb4-452c-88ea-8bb05f4ba75e req-0e911b3c-322c-493a-a690-7f7e01c15071 service nova] Acquiring lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-69f255a7-8eb4-452c-88ea-8bb05f4ba75e req-0e911b3c-322c-493a-a690-7f7e01c15071 service nova] Acquired lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG nova.network.neutron [req-69f255a7-8eb4-452c-88ea-8bb05f4ba75e req-0e911b3c-322c-493a-a690-7f7e01c15071 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Refreshing network info cache for port 6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1613ac0d-a619-4c89-a531-164647a246b7) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:14:01 user nova-compute[75993]: INFO os_vif [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc')
Nov 08 22:14:01 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Deleting instance files /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874_del
Nov 08 22:14:01 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Deletion of /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874_del complete
Nov 08 22:14:01 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Deleted allocations for instance 28e74bf5-96eb-4251-a597-2795cd352874
Nov 08 22:14:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:14:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:14:02 user nova-compute[75993]: DEBUG nova.objects.instance [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'numa_topology' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:14:02 user nova-compute[75993]: DEBUG nova.objects.base [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Object Instance<28e74bf5-96eb-4251-a597-2795cd352874> lazy-loaded attributes: resources,numa_topology {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:14:02 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:14:02 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:14:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.099s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:14:02 user nova-compute[75993]: DEBUG nova.network.neutron [req-69f255a7-8eb4-452c-88ea-8bb05f4ba75e req-0e911b3c-322c-493a-a690-7f7e01c15071 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updated VIF entry in instance network info cache for port 6e4eeabe-bca9-410f-b00a-c4d8b8c876f8. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:14:02 user nova-compute[75993]: DEBUG nova.network.neutron [req-69f255a7-8eb4-452c-88ea-8bb05f4ba75e req-0e911b3c-322c-493a-a690-7f7e01c15071 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating instance_info_cache with network_info: [{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:14:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-66c8b9e1-073d-422c-930a-57b8e891cce5 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "28e74bf5-96eb-4251-a597-2795cd352874" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.603s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:14:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-69f255a7-8eb4-452c-88ea-8bb05f4ba75e req-0e911b3c-322c-493a-a690-7f7e01c15071 service nova] Releasing lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:14:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:20 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:14:21 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:14:21 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:14:21 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:14:21 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:14:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:14:25 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:14:26 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:14:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:27 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:14:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:14:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:14:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:14:27 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:14:27 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:14:27 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:14:27 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9054MB free_disk=25.013526916503906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:14:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:14:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:14:27 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:14:27 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:14:27 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:14:28 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:14:28 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:14:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:14:30 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:14:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:14:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:14:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:14:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:14:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:14:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:14:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:15:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:21 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:22 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:22 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:15:22 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:15:22 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:15:25 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:25 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:27 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:28 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:15:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:15:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:15:29 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:15:29 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:15:29 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:15:29 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9062MB free_disk=25.011032104492188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:15:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:15:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:15:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:15:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:15:30 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 22:15:30 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 22:15:30 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 22:15:30 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 22:15:30 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 22:15:30 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:15:30 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:15:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:15:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:15:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:15:33 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:36 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 22:15:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 22:15:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:40 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:15:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 22:15:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:15:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "28e74bf5-96eb-4251-a597-2795cd352874" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:15:50 user nova-compute[75993]: INFO nova.compute.manager [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Unshelving
Nov 08 22:15:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:15:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:15:51 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'pci_requests' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:15:51 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'numa_topology' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:15:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:15:51 user nova-compute[75993]: INFO nova.compute.claims [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Claim successful on node user
Nov 08 22:15:51 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:15:51 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:15:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:15:51 user nova-compute[75993]: INFO nova.network.neutron [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating port 6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 08 22:15:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquired lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-54bf1521-a97a-45a9-94b5-435ac0cae098 req-a0bf7a8c-2a13-4b0a-8cb1-8b93065cb1b5 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-changed-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-54bf1521-a97a-45a9-94b5-435ac0cae098 req-a0bf7a8c-2a13-4b0a-8cb1-8b93065cb1b5 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Refreshing instance network info cache due to event network-changed-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54bf1521-a97a-45a9-94b5-435ac0cae098 req-a0bf7a8c-2a13-4b0a-8cb1-8b93065cb1b5 service nova] Acquiring lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG nova.network.neutron [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating instance_info_cache with network_info: [{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Releasing lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:15:52 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Creating image(s)
Nov 08 22:15:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "/opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "/opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "/opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'trusted_certs' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54bf1521-a97a-45a9-94b5-435ac0cae098 req-a0bf7a8c-2a13-4b0a-8cb1-8b93065cb1b5 service nova] Acquired lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG nova.network.neutron [req-54bf1521-a97a-45a9-94b5-435ac0cae098 req-a0bf7a8c-2a13-4b0a-8cb1-8b93065cb1b5 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Refreshing network info cache for port 6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG nova.objects.base [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Object Instance<28e74bf5-96eb-4251-a597-2795cd352874> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:15:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:15:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e.part --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:15:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:15:53 user nova-compute[75993]: DEBUG nova.virt.images [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] 7327590c-ce66-4c69-965f-ee80b80d5921 was qcow2, converting to raw {{(pid=75993) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 08 22:15:53 user nova-compute[75993]: DEBUG nova.privsep.utils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75993) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 08 22:15:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e.part /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e.converted {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG nova.network.neutron [req-54bf1521-a97a-45a9-94b5-435ac0cae098 req-a0bf7a8c-2a13-4b0a-8cb1-8b93065cb1b5 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updated VIF entry in instance network info cache for port 6e4eeabe-bca9-410f-b00a-c4d8b8c876f8. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG nova.network.neutron [req-54bf1521-a97a-45a9-94b5-435ac0cae098 req-a0bf7a8c-2a13-4b0a-8cb1-8b93065cb1b5 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating instance_info_cache with network_info: [{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54bf1521-a97a-45a9-94b5-435ac0cae098 req-a0bf7a8c-2a13-4b0a-8cb1-8b93065cb1b5 service nova] Releasing lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e.part /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e.converted" returned: 0 in 0.645s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e.converted --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.076s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:15:54 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:15:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e --force-share --output=json" returned: 0 in 0.221s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:15:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e,backing_fmt=raw /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:15:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e,backing_fmt=raw /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk 1073741824" returned: 0 in 0.057s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:15:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:15:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:15:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb9f9bf2bad8da7cdeed48cdfa43869f84d11d0e --force-share --output=json" returned: 0 in 0.203s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:15:55 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'migration_context' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:15:55 user nova-compute[75993]: DEBUG nova.objects.base [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Object Instance<28e74bf5-96eb-4251-a597-2795cd352874> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:15:55 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Rebasing disk image.
Nov 08 22:15:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:15:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.219s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:15:55 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be -F raw /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:15:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be -F raw /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk" returned: 0 in 2.060s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Ensure instance console log exists: /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Start _get_guest_xml network_info=[{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f4b7bcd3e68b5563e3040cbe50dd793d',container_format='bare',created_at=2023-11-08T22:13:56Z,direct_url=<?>,disk_format='qcow2',id=7327590c-ce66-4c69-965f-ee80b80d5921,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1763570869-shelved',owner='cb7a28285c5c4db9aa84b223a2235839',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T22:14:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:15:57 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:15:57 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f4b7bcd3e68b5563e3040cbe50dd793d',container_format='bare',created_at=2023-11-08T22:13:56Z,direct_url=<?>,disk_format='qcow2',id=7327590c-ce66-4c69-965f-ee80b80d5921,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1763570869-shelved',owner='cb7a28285c5c4db9aa84b223a2235839',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-08T22:14:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'vcpu_model' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.objects.base [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Object Instance<28e74bf5-96eb-4251-a597-2795cd352874> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T22:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1763570869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1763570869',id=41,image_ref='7327590c-ce66-4c69-965f-ee80b80d5921',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-304529612',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:12:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-ab5vtu9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member',shelved_at='2023-11-08T22:14:00.464665',shelved_host='user',shelved_image_id='7327590c-ce66-4c69-965f-ee80b80d5921'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:15:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=28e74bf5-96eb-4251-a597-2795cd352874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'pci_devices' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.objects.base [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Object Instance<28e74bf5-96eb-4251-a597-2795cd352874> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75993) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:15:57 user nova-compute[75993]:   <uuid>28e74bf5-96eb-4251-a597-2795cd352874</uuid>
Nov 08 22:15:57 user nova-compute[75993]:   <name>instance-00000029</name>
Nov 08 22:15:57 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:15:57 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:15:57 user nova-compute[75993]:   <metadata>
Nov 08 22:15:57 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:15:57 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:15:57 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1763570869</nova:name>
Nov 08 22:15:57 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:15:57</nova:creationTime>
Nov 08 22:15:57 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:15:57 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:15:57 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:15:57 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:15:57 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:15:57 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:15:57 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:15:57 user nova-compute[75993]:       <nova:owner>
Nov 08 22:15:57 user nova-compute[75993]:         <nova:user uuid="2ddac60afc3b4fe9a9f85774fd1b8513">tempest-AttachVolumeShelveTestJSON-1533063344-project-member</nova:user>
Nov 08 22:15:57 user nova-compute[75993]:         <nova:project uuid="cb7a28285c5c4db9aa84b223a2235839">tempest-AttachVolumeShelveTestJSON-1533063344</nova:project>
Nov 08 22:15:57 user nova-compute[75993]:       </nova:owner>
Nov 08 22:15:57 user nova-compute[75993]:       <nova:root type="image" uuid="7327590c-ce66-4c69-965f-ee80b80d5921"/>
Nov 08 22:15:57 user nova-compute[75993]:       <nova:ports>
Nov 08 22:15:57 user nova-compute[75993]:         <nova:port uuid="6e4eeabe-bca9-410f-b00a-c4d8b8c876f8">
Nov 08 22:15:57 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 08 22:15:57 user nova-compute[75993]:         </nova:port>
Nov 08 22:15:57 user nova-compute[75993]:       </nova:ports>
Nov 08 22:15:57 user nova-compute[75993]:     </nova:instance>
Nov 08 22:15:57 user nova-compute[75993]:   </metadata>
Nov 08 22:15:57 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:15:57 user nova-compute[75993]:     <system>
Nov 08 22:15:57 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:15:57 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:15:57 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:15:57 user nova-compute[75993]:       <entry name="serial">28e74bf5-96eb-4251-a597-2795cd352874</entry>
Nov 08 22:15:57 user nova-compute[75993]:       <entry name="uuid">28e74bf5-96eb-4251-a597-2795cd352874</entry>
Nov 08 22:15:57 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:15:57 user nova-compute[75993]:     </system>
Nov 08 22:15:57 user nova-compute[75993]:   </sysinfo>
Nov 08 22:15:57 user nova-compute[75993]:   <os>
Nov 08 22:15:57 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:15:57 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:15:57 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:15:57 user nova-compute[75993]:   </os>
Nov 08 22:15:57 user nova-compute[75993]:   <features>
Nov 08 22:15:57 user nova-compute[75993]:     <acpi/>
Nov 08 22:15:57 user nova-compute[75993]:     <apic/>
Nov 08 22:15:57 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:15:57 user nova-compute[75993]:   </features>
Nov 08 22:15:57 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:15:57 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:15:57 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:15:57 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:15:57 user nova-compute[75993]:   </clock>
Nov 08 22:15:57 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:15:57 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:15:57 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:15:57 user nova-compute[75993]:   </cpu>
Nov 08 22:15:57 user nova-compute[75993]:   <devices>
Nov 08 22:15:57 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 22:15:57 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 22:15:57 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk"/>
Nov 08 22:15:57 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:15:57 user nova-compute[75993]:     </disk>
Nov 08 22:15:57 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:15:57 user nova-compute[75993]:       <mac address="fa:16:3e:87:30:07"/>
Nov 08 22:15:57 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:15:57 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:15:57 user nova-compute[75993]:       <target dev="tap6e4eeabe-bc"/>
Nov 08 22:15:57 user nova-compute[75993]:     </interface>
Nov 08 22:15:57 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:15:57 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/console.log" append="off"/>
Nov 08 22:15:57 user nova-compute[75993]:     </serial>
Nov 08 22:15:57 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:15:57 user nova-compute[75993]:     <video>
Nov 08 22:15:57 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:15:57 user nova-compute[75993]:     </video>
Nov 08 22:15:57 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:15:57 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:15:57 user nova-compute[75993]:     </rng>
Nov 08 22:15:57 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:15:57 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:15:57 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:15:57 user nova-compute[75993]:     </memballoon>
Nov 08 22:15:57 user nova-compute[75993]:   </devices>
Nov 08 22:15:57 user nova-compute[75993]: </domain>
Nov 08 22:15:57 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T22:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1763570869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1763570869',id=41,image_ref='7327590c-ce66-4c69-965f-ee80b80d5921',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-304529612',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:12:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-ab5vtu9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member',shelved_at='2023-11-08T22:14:00.464665',shelved_host='user',shelved_image_id='7327590c-ce66-4c69-965f-ee80b80d5921'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:15:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=28e74bf5-96eb-4251-a597-2795cd352874,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG os_vif [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e13538c-3016-538f-9b61-b8fa61be1062', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e4eeabe-bc, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e4eeabe-bc, col_values=(('qos', UUID('f70c8ae6-a523-4bb1-9806-6d9096fe6f70')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e4eeabe-bc, col_values=(('external_ids', {'iface-id': '6e4eeabe-bca9-410f-b00a-c4d8b8c876f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:30:07', 'vm-uuid': '28e74bf5-96eb-4251-a597-2795cd352874'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:57 user nova-compute[75993]: INFO os_vif [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc')
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:15:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] No VIF found with MAC fa:16:3e:87:30:07, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:15:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-13bccde4-c0ad-4d01-b55d-100d3ed42b0d req-e21125bd-a6ec-417d-bf02-5fd4de146a3f service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:15:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-13bccde4-c0ad-4d01-b55d-100d3ed42b0d req-e21125bd-a6ec-417d-bf02-5fd4de146a3f service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:15:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-13bccde4-c0ad-4d01-b55d-100d3ed42b0d req-e21125bd-a6ec-417d-bf02-5fd4de146a3f service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:15:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-13bccde4-c0ad-4d01-b55d-100d3ed42b0d req-e21125bd-a6ec-417d-bf02-5fd4de146a3f service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:15:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-13bccde4-c0ad-4d01-b55d-100d3ed42b0d req-e21125bd-a6ec-417d-bf02-5fd4de146a3f service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:15:59 user nova-compute[75993]: WARNING nova.compute.manager [req-13bccde4-c0ad-4d01-b55d-100d3ed42b0d req-e21125bd-a6ec-417d-bf02-5fd4de146a3f service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received unexpected event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 22:15:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:15:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:01 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:16:01 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:16:01 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Instance spawned successfully.
Nov 08 22:16:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-0e2c3a67-2edc-48e4-a5fa-92b64f365480 req-2d8aba83-566c-49c5-8f7e-1c7ba3f273c6 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:16:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0e2c3a67-2edc-48e4-a5fa-92b64f365480 req-2d8aba83-566c-49c5-8f7e-1c7ba3f273c6 service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:16:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0e2c3a67-2edc-48e4-a5fa-92b64f365480 req-2d8aba83-566c-49c5-8f7e-1c7ba3f273c6 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:16:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0e2c3a67-2edc-48e4-a5fa-92b64f365480 req-2d8aba83-566c-49c5-8f7e-1c7ba3f273c6 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:16:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-0e2c3a67-2edc-48e4-a5fa-92b64f365480 req-2d8aba83-566c-49c5-8f7e-1c7ba3f273c6 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:16:01 user nova-compute[75993]: WARNING nova.compute.manager [req-0e2c3a67-2edc-48e4-a5fa-92b64f365480 req-2d8aba83-566c-49c5-8f7e-1c7ba3f273c6 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received unexpected event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 08 22:16:01 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:16:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f7b90a14-2796-4a69-8959-e7ae11b4ee6c tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "28e74bf5-96eb-4251-a597-2795cd352874" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.687s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:16:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:16:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:16:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:16:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:16:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:22 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:16:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "346c4bbf-753e-4e94-b96c-445faf0b5756" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:16:23 user nova-compute[75993]: INFO nova.compute.claims [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Claim successful on node user
Nov 08 22:16:23 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.228s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:16:23 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:16:23 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:16:23 user nova-compute[75993]: DEBUG nova.policy [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4d2f038c60247b894c8849ee3b9183b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef08c827c91436bb907130af0c4f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:16:23 user nova-compute[75993]: INFO nova.virt.block_device [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Booting with volume snapshot 3df8423e-fa53-423e-ab29-9dd26844caba at /dev/vda
Nov 08 22:16:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:24 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Successfully created port: 841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:16:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:16:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:16:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:16:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Skipping network cache update for instance because it is Building. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 08 22:16:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:16:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:16:24 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:16:24 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Successfully updated port: 841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "refresh_cache-346c4bbf-753e-4e94-b96c-445faf0b5756" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquired lock "refresh_cache-346c4bbf-753e-4e94-b96c-445faf0b5756" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-4ccd4028-6005-409d-ba3d-f8188d14366e req-40684442-a63d-42ef-8f21-d88c6b6d81cf service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-changed-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-4ccd4028-6005-409d-ba3d-f8188d14366e req-40684442-a63d-42ef-8f21-d88c6b6d81cf service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Refreshing instance network info cache due to event network-changed-841d1899-5fc2-41f6-8ed3-22c5b873cfd5. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4ccd4028-6005-409d-ba3d-f8188d14366e req-40684442-a63d-42ef-8f21-d88c6b6d81cf service nova] Acquiring lock "refresh_cache-346c4bbf-753e-4e94-b96c-445faf0b5756" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating instance_info_cache with network_info: [{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Updating instance_info_cache with network_info: [{"id": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "address": "fa:16:3e:e5:38:8d", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841d1899-5f", "ovs_interfaceid": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Releasing lock "refresh_cache-346c4bbf-753e-4e94-b96c-445faf0b5756" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Instance network_info: |[{"id": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "address": "fa:16:3e:e5:38:8d", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841d1899-5f", "ovs_interfaceid": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4ccd4028-6005-409d-ba3d-f8188d14366e req-40684442-a63d-42ef-8f21-d88c6b6d81cf service nova] Acquired lock "refresh_cache-346c4bbf-753e-4e94-b96c-445faf0b5756" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-4ccd4028-6005-409d-ba3d-f8188d14366e req-40684442-a63d-42ef-8f21-d88c6b6d81cf service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Refreshing network info cache for port 841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-4ccd4028-6005-409d-ba3d-f8188d14366e req-40684442-a63d-42ef-8f21-d88c6b6d81cf service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Updated VIF entry in instance network info cache for port 841d1899-5fc2-41f6-8ed3-22c5b873cfd5. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG nova.network.neutron [req-4ccd4028-6005-409d-ba3d-f8188d14366e req-40684442-a63d-42ef-8f21-d88c6b6d81cf service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Updating instance_info_cache with network_info: [{"id": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "address": "fa:16:3e:e5:38:8d", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841d1899-5f", "ovs_interfaceid": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:16:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4ccd4028-6005-409d-ba3d-f8188d14366e req-40684442-a63d-42ef-8f21-d88c6b6d81cf service nova] Releasing lock "refresh_cache-346c4bbf-753e-4e94-b96c-445faf0b5756" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:16:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:27 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:16:27 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:16:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:28 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG os_brick.utils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e063e-2561-4296-8a2a-5e2a84fb4ec3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc61585-73e3-4be8-a164-4da719cbb5be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[77732f01-d6a5-4240-bcba-ed39d9e0c907]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[417d8a8e-e819-40fb-bdfa-3214f696dcae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:16:29 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0025247-8d6d-41d0-8840-0eafc894dc55]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG os_brick.utils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Updating existing volume attachment record: 96bfeee3-e9f4-427e-b6db-df4d041acc2f {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:16:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:16:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8880MB free_disk=24.98297119140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:16:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:16:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:16:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 28e74bf5-96eb-4251-a597-2795cd352874 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:16:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 346c4bbf-753e-4e94-b96c-445faf0b5756 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:16:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:16:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:16:30 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:16:30 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:16:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:16:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:16:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:16:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:34 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:16:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:16:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:16:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:16:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:16:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:16:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:16:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:16:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:16:51 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Creating image(s)
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Ensure instance console log exists: /opt/stack/data/nova/instances/346c4bbf-753e-4e94-b96c-445faf0b5756/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Start _get_guest_xml network_info=[{"id": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "address": "fa:16:3e:e5:38:8d", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841d1899-5f", "ovs_interfaceid": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '96bfeee3-e9f4-427e-b6db-df4d041acc2f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaBczVHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '346c4bbf-753e-4e94-b96c-445faf0b5756', 'attached_at': '', 'detached_at': '', 'volume_id': '763ee694-313f-40dc-9dbf-401a8abd2a99', 'serial': '763ee694-313f-40dc-9dbf-401a8abd2a99'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:16:51 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:16:51 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaBczVHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:16:51 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:16:51 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:16:51 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d35e37-c46b-4723-a559-4fd07afceaa3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:16:51 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[711a85a8-1981-40d5-b173-e74a82ebd0d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99] added
Nov 08 22:16:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed91f72-c8c3-49f2-b993-825ef5f9ed6a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d45978-16ce-4347-8448-e0867d3589e5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaBczVHi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaBczVHi" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[948432e5-e7a1-48a3-967d-3295c9b433c0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaBczVHi'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91b0796-aa26-422f-913e-59fb0821838f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0faf8e7-3897-48c8-a800-7ba7b102a705]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:16:51 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:16:51 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:16:51 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 22:16:51 user nova-compute[75993]: 
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[03840147-e70b-42f6-9156-dd1321eaf8f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99, portal: 172.16.0.220,3260]
Nov 08 22:16:51 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99, portal: 172.16.0.220,3260] successful.
Nov 08 22:16:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d396fb-bafc-434a-a3ab-51e6fb063b79]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8e9051-1662-4495-ba37-1e2903f39f40]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 (non-flash)
Nov 08 22:16:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 (non-flash)
Nov 08 22:16:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e394fd-bc11-4092-ad63-43f4a4f37a1a]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:16:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaBczVHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23765386236616139', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765386236616139', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-9151161',display_name='tempest-TestVolumeBootPattern-server-9151161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-9151161',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-dy2ataqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:16:24Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=346c4bbf-753e-4e94-b96c-445faf0b5756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "address": "fa:16:3e:e5:38:8d", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841d1899-5f", "ovs_interfaceid": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "address": "fa:16:3e:e5:38:8d", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841d1899-5f", "ovs_interfaceid": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:38:8d,bridge_name='br-int',has_traffic_filtering=True,id=841d1899-5fc2-41f6-8ed3-22c5b873cfd5,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841d1899-5f') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'pci_devices' on Instance uuid 346c4bbf-753e-4e94-b96c-445faf0b5756 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:16:52 user nova-compute[75993]:   <uuid>346c4bbf-753e-4e94-b96c-445faf0b5756</uuid>
Nov 08 22:16:52 user nova-compute[75993]:   <name>instance-0000002a</name>
Nov 08 22:16:52 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:16:52 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:16:52 user nova-compute[75993]:   <metadata>
Nov 08 22:16:52 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:16:52 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:16:52 user nova-compute[75993]:       <nova:name>tempest-TestVolumeBootPattern-server-9151161</nova:name>
Nov 08 22:16:52 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:16:51</nova:creationTime>
Nov 08 22:16:52 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:16:52 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:16:52 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:16:52 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:16:52 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:16:52 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:16:52 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:16:52 user nova-compute[75993]:       <nova:owner>
Nov 08 22:16:52 user nova-compute[75993]:         <nova:user uuid="e4d2f038c60247b894c8849ee3b9183b">tempest-TestVolumeBootPattern-1717039666-project-member</nova:user>
Nov 08 22:16:52 user nova-compute[75993]:         <nova:project uuid="9ef08c827c91436bb907130af0c4f031">tempest-TestVolumeBootPattern-1717039666</nova:project>
Nov 08 22:16:52 user nova-compute[75993]:       </nova:owner>
Nov 08 22:16:52 user nova-compute[75993]:       <nova:ports>
Nov 08 22:16:52 user nova-compute[75993]:         <nova:port uuid="841d1899-5fc2-41f6-8ed3-22c5b873cfd5">
Nov 08 22:16:52 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 22:16:52 user nova-compute[75993]:         </nova:port>
Nov 08 22:16:52 user nova-compute[75993]:       </nova:ports>
Nov 08 22:16:52 user nova-compute[75993]:     </nova:instance>
Nov 08 22:16:52 user nova-compute[75993]:   </metadata>
Nov 08 22:16:52 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:16:52 user nova-compute[75993]:     <system>
Nov 08 22:16:52 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:16:52 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:16:52 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:16:52 user nova-compute[75993]:       <entry name="serial">346c4bbf-753e-4e94-b96c-445faf0b5756</entry>
Nov 08 22:16:52 user nova-compute[75993]:       <entry name="uuid">346c4bbf-753e-4e94-b96c-445faf0b5756</entry>
Nov 08 22:16:52 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:16:52 user nova-compute[75993]:     </system>
Nov 08 22:16:52 user nova-compute[75993]:   </sysinfo>
Nov 08 22:16:52 user nova-compute[75993]:   <os>
Nov 08 22:16:52 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:16:52 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:16:52 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:16:52 user nova-compute[75993]:   </os>
Nov 08 22:16:52 user nova-compute[75993]:   <features>
Nov 08 22:16:52 user nova-compute[75993]:     <acpi/>
Nov 08 22:16:52 user nova-compute[75993]:     <apic/>
Nov 08 22:16:52 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:16:52 user nova-compute[75993]:   </features>
Nov 08 22:16:52 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:16:52 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:16:52 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:16:52 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:16:52 user nova-compute[75993]:   </clock>
Nov 08 22:16:52 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:16:52 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:16:52 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:16:52 user nova-compute[75993]:   </cpu>
Nov 08 22:16:52 user nova-compute[75993]:   <devices>
Nov 08 22:16:52 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 22:16:52 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:16:52 user nova-compute[75993]:       <source dev="/dev/sdb"/>
Nov 08 22:16:52 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:16:52 user nova-compute[75993]:       <serial>763ee694-313f-40dc-9dbf-401a8abd2a99</serial>
Nov 08 22:16:52 user nova-compute[75993]:     </disk>
Nov 08 22:16:52 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:16:52 user nova-compute[75993]:       <mac address="fa:16:3e:e5:38:8d"/>
Nov 08 22:16:52 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:16:52 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:16:52 user nova-compute[75993]:       <target dev="tap841d1899-5f"/>
Nov 08 22:16:52 user nova-compute[75993]:     </interface>
Nov 08 22:16:52 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:16:52 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/346c4bbf-753e-4e94-b96c-445faf0b5756/console.log" append="off"/>
Nov 08 22:16:52 user nova-compute[75993]:     </serial>
Nov 08 22:16:52 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:16:52 user nova-compute[75993]:     <video>
Nov 08 22:16:52 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:16:52 user nova-compute[75993]:     </video>
Nov 08 22:16:52 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:16:52 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:16:52 user nova-compute[75993]:     </rng>
Nov 08 22:16:52 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:16:52 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:16:52 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:16:52 user nova-compute[75993]:     </memballoon>
Nov 08 22:16:52 user nova-compute[75993]:   </devices>
Nov 08 22:16:52 user nova-compute[75993]: </domain>
Nov 08 22:16:52 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-9151161',display_name='tempest-TestVolumeBootPattern-server-9151161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-9151161',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-dy2ataqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:16:24Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=346c4bbf-753e-4e94-b96c-445faf0b5756,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "address": "fa:16:3e:e5:38:8d", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841d1899-5f", "ovs_interfaceid": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "address": "fa:16:3e:e5:38:8d", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841d1899-5f", "ovs_interfaceid": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:38:8d,bridge_name='br-int',has_traffic_filtering=True,id=841d1899-5fc2-41f6-8ed3-22c5b873cfd5,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841d1899-5f') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG os_vif [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:38:8d,bridge_name='br-int',has_traffic_filtering=True,id=841d1899-5fc2-41f6-8ed3-22c5b873cfd5,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841d1899-5f') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05443356-b429-5646-8461-16f9d099bd5a', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap841d1899-5f, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap841d1899-5f, col_values=(('qos', UUID('429e85b6-fc2c-4d52-bd83-d6e26b9cf9d5')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap841d1899-5f, col_values=(('external_ids', {'iface-id': '841d1899-5fc2-41f6-8ed3-22c5b873cfd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:38:8d', 'vm-uuid': '346c4bbf-753e-4e94-b96c-445faf0b5756'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:52 user nova-compute[75993]: INFO os_vif [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:38:8d,bridge_name='br-int',has_traffic_filtering=True,id=841d1899-5fc2-41f6-8ed3-22c5b873cfd5,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841d1899-5f')
Nov 08 22:16:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:16:52 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No VIF found with MAC fa:16:3e:e5:38:8d, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:16:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:54 user nova-compute[75993]: DEBUG nova.compute.manager [req-08176757-9454-4d9c-b869-04d07fe7a67d req-2a66d286-0053-4540-9885-12ace8fc4336 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:16:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-08176757-9454-4d9c-b869-04d07fe7a67d req-2a66d286-0053-4540-9885-12ace8fc4336 service nova] Acquiring lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:16:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-08176757-9454-4d9c-b869-04d07fe7a67d req-2a66d286-0053-4540-9885-12ace8fc4336 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:16:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-08176757-9454-4d9c-b869-04d07fe7a67d req-2a66d286-0053-4540-9885-12ace8fc4336 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:16:54 user nova-compute[75993]: DEBUG nova.compute.manager [req-08176757-9454-4d9c-b869-04d07fe7a67d req-2a66d286-0053-4540-9885-12ace8fc4336 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] No waiting events found dispatching network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:16:54 user nova-compute[75993]: WARNING nova.compute.manager [req-08176757-9454-4d9c-b869-04d07fe7a67d req-2a66d286-0053-4540-9885-12ace8fc4336 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received unexpected event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 for instance with vm_state building and task_state spawning.
Nov 08 22:16:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:16:56 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Instance spawned successfully.
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:16:56 user nova-compute[75993]: INFO nova.compute.manager [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-8a7a000a-38d8-471d-923f-4c3bf402fd2d req-cf8534e8-4163-4f95-be0c-ec8feacd6276 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8a7a000a-38d8-471d-923f-4c3bf402fd2d req-cf8534e8-4163-4f95-be0c-ec8feacd6276 service nova] Acquiring lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8a7a000a-38d8-471d-923f-4c3bf402fd2d req-cf8534e8-4163-4f95-be0c-ec8feacd6276 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-8a7a000a-38d8-471d-923f-4c3bf402fd2d req-cf8534e8-4163-4f95-be0c-ec8feacd6276 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-8a7a000a-38d8-471d-923f-4c3bf402fd2d req-cf8534e8-4163-4f95-be0c-ec8feacd6276 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] No waiting events found dispatching network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:16:56 user nova-compute[75993]: WARNING nova.compute.manager [req-8a7a000a-38d8-471d-923f-4c3bf402fd2d req-cf8534e8-4163-4f95-be0c-ec8feacd6276 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received unexpected event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 for instance with vm_state building and task_state spawning.
Nov 08 22:16:56 user nova-compute[75993]: INFO nova.compute.manager [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Took 32.98 seconds to build instance.
Nov 08 22:16:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e64af2e5-1189-46ba-b5ae-23cf0a638f54 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.080s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:16:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:16:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:22 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:17:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:17:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:17:24 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:17:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:17:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:17:24 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:17:24 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:17:24 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating instance_info_cache with network_info: [{"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:17:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-28e74bf5-96eb-4251-a597-2795cd352874" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:17:25 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:17:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:28 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:17:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:17:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:17:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:17:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:17:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:17:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:17:29 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:17:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:17:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:17:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:17:29 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:17:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:17:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:17:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:17:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8799MB free_disk=24.981590270996094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:17:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:17:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:17:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 28e74bf5-96eb-4251-a597-2795cd352874 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:17:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 346c4bbf-753e-4e94-b96c-445faf0b5756 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:17:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:17:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:17:30 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:17:30 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:17:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:17:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:17:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:17:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:17:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:17:36 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:17:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:17:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:17:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:17:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:17:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "28e74bf5-96eb-4251-a597-2795cd352874" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:17:40 user nova-compute[75993]: INFO nova.compute.manager [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Terminating instance
Nov 08 22:17:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cb262b9-306c-4bd5-ac88-d1c66fd9d8bc req-6d29e3f6-9376-4405-8b62-49b11d4416a9 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-unplugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cb262b9-306c-4bd5-ac88-d1c66fd9d8bc req-6d29e3f6-9376-4405-8b62-49b11d4416a9 service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cb262b9-306c-4bd5-ac88-d1c66fd9d8bc req-6d29e3f6-9376-4405-8b62-49b11d4416a9 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0cb262b9-306c-4bd5-ac88-d1c66fd9d8bc req-6d29e3f6-9376-4405-8b62-49b11d4416a9 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cb262b9-306c-4bd5-ac88-d1c66fd9d8bc req-6d29e3f6-9376-4405-8b62-49b11d4416a9 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-unplugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG nova.compute.manager [req-0cb262b9-306c-4bd5-ac88-d1c66fd9d8bc req-6d29e3f6-9376-4405-8b62-49b11d4416a9 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-unplugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Instance destroyed successfully.
Nov 08 22:17:41 user nova-compute[75993]: DEBUG nova.objects.instance [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lazy-loading 'resources' on Instance uuid 28e74bf5-96eb-4251-a597-2795cd352874 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-08T22:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1763570869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1763570869',id=41,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH68muvupe3C41ngkmkwiUrPZ08dTr6lOQnVcgf0qPBLWIBpTqKWdnIbGZnFePGEfYChIOzHxeFWB59utxOADzliTBqmBZpF3YB92Dh7I/D2dkegz4H5LeHSAg3zy1g7KQ==',key_name='tempest-keypair-304529612',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb7a28285c5c4db9aa84b223a2235839',ramdisk_id='',reservation_id='r-ab5vtu9h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1533063344',owner_user_name='tempest-AttachVolumeShelveTestJSON-1533063344-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:16:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ddac60afc3b4fe9a9f85774fd1b8513',uuid=28e74bf5-96eb-4251-a597-2795cd352874,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converting VIF {"id": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "address": "fa:16:3e:87:30:07", "network": {"id": "71d3bf18-28a0-4c10-b63d-3c59200b358a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1555457166-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb7a28285c5c4db9aa84b223a2235839", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e4eeabe-bc", "ovs_interfaceid": "6e4eeabe-bca9-410f-b00a-c4d8b8c876f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG os_vif [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e4eeabe-bc, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f70c8ae6-a523-4bb1-9806-6d9096fe6f70) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:17:41 user nova-compute[75993]: INFO os_vif [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:30:07,bridge_name='br-int',has_traffic_filtering=True,id=6e4eeabe-bca9-410f-b00a-c4d8b8c876f8,network=Network(71d3bf18-28a0-4c10-b63d-3c59200b358a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e4eeabe-bc')
Nov 08 22:17:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Deleting instance files /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874_del
Nov 08 22:17:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Deletion of /opt/stack/data/nova/instances/28e74bf5-96eb-4251-a597-2795cd352874_del complete
Nov 08 22:17:41 user nova-compute[75993]: INFO nova.compute.manager [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 08 22:17:41 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:17:42 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Took 1.02 seconds to deallocate network for instance.
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-0d870574-3256-4850-bb0f-81f1311a48a7 req-a1576ae1-fcab-4404-93c7-867d1b170e4c service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-deleted-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:17:42 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Deleted allocations for instance 28e74bf5-96eb-4251-a597-2795cd352874
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-23b7d6dd-9f97-43b6-a8a0-562f20fffc08 tempest-AttachVolumeShelveTestJSON-1533063344 tempest-AttachVolumeShelveTestJSON-1533063344-project-member] Lock "28e74bf5-96eb-4251-a597-2795cd352874" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.075s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:17:42 user nova-compute[75993]: WARNING nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received unexpected event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with vm_state deleted and task_state None.
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:17:42 user nova-compute[75993]: WARNING nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received unexpected event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with vm_state deleted and task_state None.
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:17:42 user nova-compute[75993]: WARNING nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received unexpected event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with vm_state deleted and task_state None.
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-unplugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-unplugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:17:42 user nova-compute[75993]: WARNING nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received unexpected event network-vif-unplugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with vm_state deleted and task_state None.
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Acquiring lock "28e74bf5-96eb-4251-a597-2795cd352874-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] Lock "28e74bf5-96eb-4251-a597-2795cd352874-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:17:42 user nova-compute[75993]: DEBUG nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] No waiting events found dispatching network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:17:42 user nova-compute[75993]: WARNING nova.compute.manager [req-3565b3c1-f5a6-4430-b795-37541f1c079b req-d0cf1bb4-5f81-4760-8e78-52b0224076c2 service nova] [instance: 28e74bf5-96eb-4251-a597-2795cd352874] Received unexpected event network-vif-plugged-6e4eeabe-bca9-410f-b00a-c4d8b8c876f8 for instance with vm_state deleted and task_state None.
Nov 08 22:17:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:17:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:17:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:17:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:17:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:17:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:18:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:18:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:18:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:18:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:18:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "346c4bbf-753e-4e94-b96c-445faf0b5756" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:18:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:18:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:18:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:18:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:18:13 user nova-compute[75993]: INFO nova.compute.manager [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Terminating instance
Nov 08 22:18:13 user nova-compute[75993]: DEBUG nova.compute.manager [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:18:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-c18ea944-b679-4fc4-a283-13d2198c3356 req-2cf96033-ec79-4a3d-9b62-791ba50e28a4 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-vif-unplugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c18ea944-b679-4fc4-a283-13d2198c3356 req-2cf96033-ec79-4a3d-9b62-791ba50e28a4 service nova] Acquiring lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c18ea944-b679-4fc4-a283-13d2198c3356 req-2cf96033-ec79-4a3d-9b62-791ba50e28a4 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c18ea944-b679-4fc4-a283-13d2198c3356 req-2cf96033-ec79-4a3d-9b62-791ba50e28a4 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-c18ea944-b679-4fc4-a283-13d2198c3356 req-2cf96033-ec79-4a3d-9b62-791ba50e28a4 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] No waiting events found dispatching network-vif-unplugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-c18ea944-b679-4fc4-a283-13d2198c3356 req-2cf96033-ec79-4a3d-9b62-791ba50e28a4 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-vif-unplugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Instance destroyed successfully.
Nov 08 22:18:14 user nova-compute[75993]: DEBUG nova.objects.instance [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'resources' on Instance uuid 346c4bbf-753e-4e94-b96c-445faf0b5756 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:16:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-9151161',display_name='tempest-TestVolumeBootPattern-server-9151161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-9151161',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:16:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-dy2ataqh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:16:56Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=346c4bbf-753e-4e94-b96c-445faf0b5756,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "address": "fa:16:3e:e5:38:8d", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841d1899-5f", "ovs_interfaceid": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "address": "fa:16:3e:e5:38:8d", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841d1899-5f", "ovs_interfaceid": "841d1899-5fc2-41f6-8ed3-22c5b873cfd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:38:8d,bridge_name='br-int',has_traffic_filtering=True,id=841d1899-5fc2-41f6-8ed3-22c5b873cfd5,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841d1899-5f') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_vif [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:38:8d,bridge_name='br-int',has_traffic_filtering=True,id=841d1899-5fc2-41f6-8ed3-22c5b873cfd5,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841d1899-5f') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap841d1899-5f, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=429e85b6-fc2c-4d52-bd83-d6e26b9cf9d5) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:18:14 user nova-compute[75993]: INFO os_vif [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:38:8d,bridge_name='br-int',has_traffic_filtering=True,id=841d1899-5fc2-41f6-8ed3-22c5b873cfd5,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841d1899-5f')
Nov 08 22:18:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaBczVHi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:18:14 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[205d2c66-9271-4779-af2e-178f360646e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:18:14 user nova-compute[75993]: No targets found.
Nov 08 22:18:14 user nova-compute[75993]: iSNS:
Nov 08 22:18:14 user nova-compute[75993]: No targets found.
Nov 08 22:18:14 user nova-compute[75993]: STATIC:
Nov 08 22:18:14 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99
Nov 08 22:18:14 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:18:14 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:18:14 user nova-compute[75993]: FIRMWARE:
Nov 08 22:18:14 user nova-compute[75993]: No targets found.
Nov 08 22:18:14 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:18:14 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:18:14 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1736db-d48f-4441-b04a-5e2775de9311]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[04521538-3811-4ab6-bd82-4d91c9649a47]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 (non-flash)
Nov 08 22:18:14 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 (non-flash)
Nov 08 22:18:14 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544d19090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[792a148a-2502-47ff-916d-01f1024098c3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b192cd1c-58cc-4698-b075-5741fbc251d1]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ed3b0a-365a-4aac-99e2-94a71bdb4961]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aa367e-c4ed-4e3b-a3b7-1b24e1b067da]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f5d07-682a-44e6-b785-52deaebb2d21]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:18:14 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6418bbcf-58a3-48bf-a348-983558d63485]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99, portal: 172.16.0.220,3260]
Nov 08 22:18:15 user nova-compute[75993]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99, portal: 172.16.0.220,3260] successful.
Nov 08 22:18:15 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:763ee694-313f-40dc-9dbf-401a8abd2a99 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfef0de-8a8a-49bb-bdac-89e02622fa7b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== disconnect_volume: return (352ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:18:15 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Deleting instance files /opt/stack/data/nova/instances/346c4bbf-753e-4e94-b96c-445faf0b5756_del
Nov 08 22:18:15 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Deletion of /opt/stack/data/nova/instances/346c4bbf-753e-4e94-b96c-445faf0b5756_del complete
Nov 08 22:18:15 user nova-compute[75993]: INFO nova.compute.manager [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 08 22:18:15 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:18:15 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Took 0.41 seconds to deallocate network for instance.
Nov 08 22:18:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-d12101ad-fb14-45b7-80c7-e1f26bdfffd8 req-3048d9e2-ae0b-4de2-af05-886fa260f392 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-vif-deleted-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:18:15 user nova-compute[75993]: INFO nova.compute.manager [req-d12101ad-fb14-45b7-80c7-e1f26bdfffd8 req-3048d9e2-ae0b-4de2-af05-886fa260f392 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Neutron deleted interface 841d1899-5fc2-41f6-8ed3-22c5b873cfd5; detaching it from the instance and deleting it from the info cache
Nov 08 22:18:15 user nova-compute[75993]: DEBUG nova.network.neutron [req-d12101ad-fb14-45b7-80c7-e1f26bdfffd8 req-3048d9e2-ae0b-4de2-af05-886fa260f392 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:18:15 user nova-compute[75993]: DEBUG nova.compute.manager [req-d12101ad-fb14-45b7-80c7-e1f26bdfffd8 req-3048d9e2-ae0b-4de2-af05-886fa260f392 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Detach interface failed, port_id=841d1899-5fc2-41f6-8ed3-22c5b873cfd5, reason: Instance 346c4bbf-753e-4e94-b96c-445faf0b5756 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Acquiring lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] No waiting events found dispatching network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:18:16 user nova-compute[75993]: WARNING nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received unexpected event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 for instance with vm_state active and task_state deleting.
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Acquiring lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] No waiting events found dispatching network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:18:16 user nova-compute[75993]: WARNING nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received unexpected event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 for instance with vm_state active and task_state deleting.
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Acquiring lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] No waiting events found dispatching network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:18:16 user nova-compute[75993]: WARNING nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received unexpected event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 for instance with vm_state active and task_state deleting.
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-vif-unplugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Acquiring lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] No waiting events found dispatching network-vif-unplugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-vif-unplugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Acquiring lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] No waiting events found dispatching network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:18:16 user nova-compute[75993]: WARNING nova.compute.manager [req-4dad29da-fea9-47ef-8c6c-9f80b6c15957 req-d26fa2d4-569f-4115-9337-e4340728b929 service nova] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Received unexpected event network-vif-plugged-841d1899-5fc2-41f6-8ed3-22c5b873cfd5 for instance with vm_state active and task_state deleting.
Nov 08 22:18:16 user nova-compute[75993]: INFO nova.compute.manager [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Took 0.94 seconds to detach 1 volumes for instance.
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.manager [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 346c4bbf-753e-4e94-b96c-445faf0b5756] Deleting volume: 763ee694-313f-40dc-9dbf-401a8abd2a99 {{(pid=75993) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:18:16 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Deleted allocations for instance 346c4bbf-753e-4e94-b96c-445faf0b5756
Nov 08 22:18:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2deb221d-2d7b-4d7f-8b8d-33e7fe09c7c6 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "346c4bbf-753e-4e94-b96c-445faf0b5756" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.925s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:18:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:22 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:18:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:18:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:18:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:18:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:18:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:26 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:18:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:18:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:18:28 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:18:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:30 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:18:30 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:18:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:18:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:18:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:18:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:18:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:18:30 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:18:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9011MB free_disk=25.000606536865234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:18:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:18:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:18:31 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:18:31 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:18:31 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:18:31 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:18:31 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:18:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:18:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:18:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:18:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:18:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:18:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:18:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:18:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:18:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:18:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:18:38 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:18:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:18:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:18:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:18:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:18:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:18:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:18:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:18:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:18:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:18:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:18:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:18:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:19:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:19:05 user nova-compute[75993]: DEBUG nova.compute.manager [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:19:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:19:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:19:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:19:05 user nova-compute[75993]: INFO nova.compute.claims [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Claim successful on node user
Nov 08 22:19:06 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG nova.compute.manager [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG nova.compute.manager [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG nova.network.neutron [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:19:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:19:06 user nova-compute[75993]: DEBUG nova.compute.manager [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG nova.policy [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be86d9fb78614dbeaaf9faa42bbf2868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8260793f85b4fa7a83c779f7f6c58e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG nova.compute.manager [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:19:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Creating image(s)
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "/opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "/opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "/opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk 1073741824" returned: 0 in 0.049s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG nova.network.neutron [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Successfully created port: 19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:19:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Cannot resize image /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Ensure instance console log exists: /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.network.neutron [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Successfully updated port: 19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquired lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.network.neutron [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.network.neutron [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-fdbfd51e-d157-477a-9c31-5ea7fb6f0d3a req-ac6cc35d-b1bd-4495-9642-f9d797c9006c service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-changed-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.compute.manager [req-fdbfd51e-d157-477a-9c31-5ea7fb6f0d3a req-ac6cc35d-b1bd-4495-9642-f9d797c9006c service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Refreshing instance network info cache due to event network-changed-19d4d016-2f33-4fe5-a283-93994869bc57. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fdbfd51e-d157-477a-9c31-5ea7fb6f0d3a req-ac6cc35d-b1bd-4495-9642-f9d797c9006c service nova] Acquiring lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.network.neutron [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updating instance_info_cache with network_info: [{"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Releasing lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.compute.manager [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Instance network_info: |[{"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fdbfd51e-d157-477a-9c31-5ea7fb6f0d3a req-ac6cc35d-b1bd-4495-9642-f9d797c9006c service nova] Acquired lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.network.neutron [req-fdbfd51e-d157-477a-9c31-5ea7fb6f0d3a req-ac6cc35d-b1bd-4495-9642-f9d797c9006c service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Refreshing network info cache for port 19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Start _get_guest_xml network_info=[{"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:19:07 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:19:07 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:19:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-513394518',display_name='tempest-AttachVolumeNegativeTest-server-513394518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-513394518',id=43,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQFCy7kQbPW8FvdgA92SeOHlnYL/VEUdIVT2RulHmsHjOtVVGmF/58VD42WTfvlPcv4/zzFGVVT4rGLybBJpXFVALJkJogb/UDOxmaFMArmjaJv9ZbWJPpDwq4gYZ/ORQ==',key_name='tempest-keypair-1006936627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-0dk0ay31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=7486651d-b863-403c-9118-c366a4e3e9e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=19d4d016-2f33-4fe5-a283-93994869bc57,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d4d016-2f') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.objects.instance [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'pci_devices' on Instance uuid 7486651d-b863-403c-9118-c366a4e3e9e0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:19:08 user nova-compute[75993]:   <uuid>7486651d-b863-403c-9118-c366a4e3e9e0</uuid>
Nov 08 22:19:08 user nova-compute[75993]:   <name>instance-0000002b</name>
Nov 08 22:19:08 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:19:08 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:19:08 user nova-compute[75993]:   <metadata>
Nov 08 22:19:08 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:19:08 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:19:08 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeNegativeTest-server-513394518</nova:name>
Nov 08 22:19:08 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:19:07</nova:creationTime>
Nov 08 22:19:08 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:19:08 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:19:08 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:19:08 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:19:08 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:19:08 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:19:08 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:19:08 user nova-compute[75993]:       <nova:owner>
Nov 08 22:19:08 user nova-compute[75993]:         <nova:user uuid="be86d9fb78614dbeaaf9faa42bbf2868">tempest-AttachVolumeNegativeTest-1149565506-project-member</nova:user>
Nov 08 22:19:08 user nova-compute[75993]:         <nova:project uuid="b8260793f85b4fa7a83c779f7f6c58e3">tempest-AttachVolumeNegativeTest-1149565506</nova:project>
Nov 08 22:19:08 user nova-compute[75993]:       </nova:owner>
Nov 08 22:19:08 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 22:19:08 user nova-compute[75993]:       <nova:ports>
Nov 08 22:19:08 user nova-compute[75993]:         <nova:port uuid="19d4d016-2f33-4fe5-a283-93994869bc57">
Nov 08 22:19:08 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 22:19:08 user nova-compute[75993]:         </nova:port>
Nov 08 22:19:08 user nova-compute[75993]:       </nova:ports>
Nov 08 22:19:08 user nova-compute[75993]:     </nova:instance>
Nov 08 22:19:08 user nova-compute[75993]:   </metadata>
Nov 08 22:19:08 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:19:08 user nova-compute[75993]:     <system>
Nov 08 22:19:08 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:19:08 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:19:08 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:19:08 user nova-compute[75993]:       <entry name="serial">7486651d-b863-403c-9118-c366a4e3e9e0</entry>
Nov 08 22:19:08 user nova-compute[75993]:       <entry name="uuid">7486651d-b863-403c-9118-c366a4e3e9e0</entry>
Nov 08 22:19:08 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:19:08 user nova-compute[75993]:     </system>
Nov 08 22:19:08 user nova-compute[75993]:   </sysinfo>
Nov 08 22:19:08 user nova-compute[75993]:   <os>
Nov 08 22:19:08 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:19:08 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:19:08 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:19:08 user nova-compute[75993]:   </os>
Nov 08 22:19:08 user nova-compute[75993]:   <features>
Nov 08 22:19:08 user nova-compute[75993]:     <acpi/>
Nov 08 22:19:08 user nova-compute[75993]:     <apic/>
Nov 08 22:19:08 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:19:08 user nova-compute[75993]:   </features>
Nov 08 22:19:08 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:19:08 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:19:08 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:19:08 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:19:08 user nova-compute[75993]:   </clock>
Nov 08 22:19:08 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:19:08 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:19:08 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:19:08 user nova-compute[75993]:   </cpu>
Nov 08 22:19:08 user nova-compute[75993]:   <devices>
Nov 08 22:19:08 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 22:19:08 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 22:19:08 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk"/>
Nov 08 22:19:08 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:19:08 user nova-compute[75993]:     </disk>
Nov 08 22:19:08 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:19:08 user nova-compute[75993]:       <mac address="fa:16:3e:ea:e9:d8"/>
Nov 08 22:19:08 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:19:08 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:19:08 user nova-compute[75993]:       <target dev="tap19d4d016-2f"/>
Nov 08 22:19:08 user nova-compute[75993]:     </interface>
Nov 08 22:19:08 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:19:08 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/console.log" append="off"/>
Nov 08 22:19:08 user nova-compute[75993]:     </serial>
Nov 08 22:19:08 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:19:08 user nova-compute[75993]:     <video>
Nov 08 22:19:08 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:19:08 user nova-compute[75993]:     </video>
Nov 08 22:19:08 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:19:08 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:19:08 user nova-compute[75993]:     </rng>
Nov 08 22:19:08 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:19:08 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:19:08 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:19:08 user nova-compute[75993]:     </memballoon>
Nov 08 22:19:08 user nova-compute[75993]:   </devices>
Nov 08 22:19:08 user nova-compute[75993]: </domain>
Nov 08 22:19:08 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-513394518',display_name='tempest-AttachVolumeNegativeTest-server-513394518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-513394518',id=43,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQFCy7kQbPW8FvdgA92SeOHlnYL/VEUdIVT2RulHmsHjOtVVGmF/58VD42WTfvlPcv4/zzFGVVT4rGLybBJpXFVALJkJogb/UDOxmaFMArmjaJv9ZbWJPpDwq4gYZ/ORQ==',key_name='tempest-keypair-1006936627',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-0dk0ay31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=7486651d-b863-403c-9118-c366a4e3e9e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=19d4d016-2f33-4fe5-a283-93994869bc57,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d4d016-2f') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG os_vif [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=19d4d016-2f33-4fe5-a283-93994869bc57,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d4d016-2f') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37c5e5a4-2a87-5141-ae4b-2a0fa671c01e', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19d4d016-2f, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19d4d016-2f, col_values=(('qos', UUID('1fbbdb27-3a9e-4d48-bdc5-4ee4e15e9262')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19d4d016-2f, col_values=(('external_ids', {'iface-id': '19d4d016-2f33-4fe5-a283-93994869bc57', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:e9:d8', 'vm-uuid': '7486651d-b863-403c-9118-c366a4e3e9e0'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:08 user nova-compute[75993]: INFO os_vif [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=19d4d016-2f33-4fe5-a283-93994869bc57,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d4d016-2f')
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No VIF found with MAC fa:16:3e:ea:e9:d8, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.network.neutron [req-fdbfd51e-d157-477a-9c31-5ea7fb6f0d3a req-ac6cc35d-b1bd-4495-9642-f9d797c9006c service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updated VIF entry in instance network info cache for port 19d4d016-2f33-4fe5-a283-93994869bc57. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG nova.network.neutron [req-fdbfd51e-d157-477a-9c31-5ea7fb6f0d3a req-ac6cc35d-b1bd-4495-9642-f9d797c9006c service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updating instance_info_cache with network_info: [{"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:19:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fdbfd51e-d157-477a-9c31-5ea7fb6f0d3a req-ac6cc35d-b1bd-4495-9642-f9d797c9006c service nova] Releasing lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:19:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-26b43448-45b2-44fc-94bd-183b10aa2334 req-f91137ae-34b2-45de-b6ff-703bca2893da service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:19:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-26b43448-45b2-44fc-94bd-183b10aa2334 req-f91137ae-34b2-45de-b6ff-703bca2893da service nova] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:19:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-26b43448-45b2-44fc-94bd-183b10aa2334 req-f91137ae-34b2-45de-b6ff-703bca2893da service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:19:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-26b43448-45b2-44fc-94bd-183b10aa2334 req-f91137ae-34b2-45de-b6ff-703bca2893da service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:19:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-26b43448-45b2-44fc-94bd-183b10aa2334 req-f91137ae-34b2-45de-b6ff-703bca2893da service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] No waiting events found dispatching network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:19:09 user nova-compute[75993]: WARNING nova.compute.manager [req-26b43448-45b2-44fc-94bd-183b10aa2334 req-f91137ae-34b2-45de-b6ff-703bca2893da service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received unexpected event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 for instance with vm_state building and task_state spawning.
Nov 08 22:19:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:19:11 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Instance spawned successfully.
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:19:11 user nova-compute[75993]: INFO nova.compute.manager [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:19:11 user nova-compute[75993]: INFO nova.compute.manager [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Took 5.85 seconds to build instance.
Nov 08 22:19:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-dfa6768e-546b-41f8-b073-eadfd28ae40d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.942s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-c920e40a-996c-4d41-94e3-daeda689327c req-2a396105-d7a0-4ec4-8f87-d34c0b21a0ef service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c920e40a-996c-4d41-94e3-daeda689327c req-2a396105-d7a0-4ec4-8f87-d34c0b21a0ef service nova] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c920e40a-996c-4d41-94e3-daeda689327c req-2a396105-d7a0-4ec4-8f87-d34c0b21a0ef service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c920e40a-996c-4d41-94e3-daeda689327c req-2a396105-d7a0-4ec4-8f87-d34c0b21a0ef service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:19:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-c920e40a-996c-4d41-94e3-daeda689327c req-2a396105-d7a0-4ec4-8f87-d34c0b21a0ef service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] No waiting events found dispatching network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:19:11 user nova-compute[75993]: WARNING nova.compute.manager [req-c920e40a-996c-4d41-94e3-daeda689327c req-2a396105-d7a0-4ec4-8f87-d34c0b21a0ef service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received unexpected event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 for instance with vm_state active and task_state None.
Nov 08 22:19:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:22 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:19:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:19:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:19:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:19:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:19:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:28 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:19:28 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:19:28 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:19:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:19:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:19:28 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:19:28 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 7486651d-b863-403c-9118-c366a4e3e9e0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:19:28 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updating instance_info_cache with network_info: [{"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:19:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:19:29 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:19:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:19:30 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:19:30 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:19:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:19:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:19:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:19:30 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:19:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:19:30 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:31 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:19:31 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:19:31 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:19:31 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8892MB free_disk=24.971397399902344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:19:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:19:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:19:31 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7486651d-b863-403c-9118-c366a4e3e9e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:19:31 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:19:31 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:19:31 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:19:31 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:19:31 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:19:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:19:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:19:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:19:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:36 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:19:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:19:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:40 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:19:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:19:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:19:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:19:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:19:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:19:46 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:19:46 user nova-compute[75993]: INFO nova.compute.claims [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Claim successful on node user
Nov 08 22:19:47 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:19:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:19:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG nova.policy [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4d2f038c60247b894c8849ee3b9183b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef08c827c91436bb907130af0c4f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:19:47 user nova-compute[75993]: INFO nova.virt.block_device [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Booting with volume 43e75452-5211-4d7e-a96f-a83b7c76953d at /dev/vda
Nov 08 22:19:47 user nova-compute[75993]: DEBUG os_brick.utils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b0797-85b0-474e-bd5e-40fa52952d36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaa4204-20b9-498e-bca8-ba02062a57e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d161f231-ab64-4c46-a126-bc3aaa72dcfa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d54e92b-3be2-4fb3-894e-772576274dcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:19:47 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:19:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f67f5b1-6bbf-48bf-a94e-1170bde968e9]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG os_brick.utils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Updating existing volume attachment record: 6983177e-84ee-48de-adef-79fa5ba6b757 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:19:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Successfully created port: 436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Successfully updated port: 436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquired lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-dea2053e-5523-47e5-81eb-a9658a803181 req-b34dd860-85ea-4cdf-9961-0661ab59dc43 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-changed-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-dea2053e-5523-47e5-81eb-a9658a803181 req-b34dd860-85ea-4cdf-9961-0661ab59dc43 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Refreshing instance network info cache due to event network-changed-436c711e-5c99-49b7-8df9-a1e1d5924b10. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dea2053e-5523-47e5-81eb-a9658a803181 req-b34dd860-85ea-4cdf-9961-0661ab59dc43 service nova] Acquiring lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG nova.network.neutron [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Updating instance_info_cache with network_info: [{"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Releasing lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Instance network_info: |[{"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dea2053e-5523-47e5-81eb-a9658a803181 req-b34dd860-85ea-4cdf-9961-0661ab59dc43 service nova] Acquired lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:19:48 user nova-compute[75993]: DEBUG nova.network.neutron [req-dea2053e-5523-47e5-81eb-a9658a803181 req-b34dd860-85ea-4cdf-9961-0661ab59dc43 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Refreshing network info cache for port 436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:19:49 user nova-compute[75993]: DEBUG nova.network.neutron [req-dea2053e-5523-47e5-81eb-a9658a803181 req-b34dd860-85ea-4cdf-9961-0661ab59dc43 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Updated VIF entry in instance network info cache for port 436c711e-5c99-49b7-8df9-a1e1d5924b10. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:19:49 user nova-compute[75993]: DEBUG nova.network.neutron [req-dea2053e-5523-47e5-81eb-a9658a803181 req-b34dd860-85ea-4cdf-9961-0661ab59dc43 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Updating instance_info_cache with network_info: [{"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:19:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-dea2053e-5523-47e5-81eb-a9658a803181 req-b34dd860-85ea-4cdf-9961-0661ab59dc43 service nova] Releasing lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:19:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:19:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:19:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:19:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:19:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:19:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:20:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:20:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:20:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:20:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:20:09 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Creating image(s)
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Ensure instance console log exists: /opt/stack/data/nova/instances/0673e053-a814-4a5e-bf67-d31f07b0c194/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Start _get_guest_xml network_info=[{"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '6983177e-84ee-48de-adef-79fa5ba6b757', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TBybcPgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0673e053-a814-4a5e-bf67-d31f07b0c194', 'attached_at': '', 'detached_at': '', 'volume_id': '43e75452-5211-4d7e-a96f-a83b7c76953d', 'serial': '43e75452-5211-4d7e-a96f-a83b7c76953d'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:20:09 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:20:09 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TBybcPgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:20:09 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:20:09 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:20:09 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[17244a36-f1ec-47de-9490-11254ad8dbbb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:20:09 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3279eac8-7fea-464c-84cb-af6c857d3b35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d] added
Nov 08 22:20:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b85a349-41ab-43a2-b852-a7dbc78098b1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[071d1e45-f1ab-4d0b-a7f8-51674a881bd6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TBybcPgJ {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TBybcPgJ" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f3b759-739c-485d-9e5b-a0d9211431c4]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TBybcPgJ'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5d71a9-2ca7-4fba-b09b-cefcc18460a5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e19354a-fdf8-435a-8523-3be87854f906]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:20:09 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:20:09 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:20:09 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 22:20:09 user nova-compute[75993]: 
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bde6b6-ecd1-4ca7-9e1c-6f254c960046]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d, portal: 172.16.0.220,3260]
Nov 08 22:20:09 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d, portal: 172.16.0.220,3260] successful.
Nov 08 22:20:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b9eba1-049f-4f4d-85d4-d9997409c6bc]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f43237-8568-4915-ba7e-7515d07c484f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:20:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:20:09 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7a6510-291b-4be6-a1ac-69d9a0e382dd]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:20:09 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TBybcPgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26662613661343364', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662613661343364', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1065517061',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1065517061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1065517061',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKll+7UmEWvkcTqIUYq60MWgpkVhK5xUTclcdrt9+QUOna6phFQ72FCVbrhoXRTnsDPnpWfVeFsYunw9J1iXtWUWdYKI8O51144UipUFnrLayJVOjWzbXEUoTxh9j7Gmcw==',key_name='tempest-keypair-1719145441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-jmvua2mu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:19:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=0673e053-a814-4a5e-bf67-d31f07b0c194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=436c711e-5c99-49b7-8df9-a1e1d5924b10,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c711e-5c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG nova.objects.instance [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'pci_devices' on Instance uuid 0673e053-a814-4a5e-bf67-d31f07b0c194 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:20:10 user nova-compute[75993]:   <uuid>0673e053-a814-4a5e-bf67-d31f07b0c194</uuid>
Nov 08 22:20:10 user nova-compute[75993]:   <name>instance-0000002c</name>
Nov 08 22:20:10 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:20:10 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:20:10 user nova-compute[75993]:   <metadata>
Nov 08 22:20:10 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:20:10 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:20:10 user nova-compute[75993]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1065517061</nova:name>
Nov 08 22:20:10 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:20:09</nova:creationTime>
Nov 08 22:20:10 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:20:10 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:20:10 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:20:10 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:20:10 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:20:10 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:20:10 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:20:10 user nova-compute[75993]:       <nova:owner>
Nov 08 22:20:10 user nova-compute[75993]:         <nova:user uuid="e4d2f038c60247b894c8849ee3b9183b">tempest-TestVolumeBootPattern-1717039666-project-member</nova:user>
Nov 08 22:20:10 user nova-compute[75993]:         <nova:project uuid="9ef08c827c91436bb907130af0c4f031">tempest-TestVolumeBootPattern-1717039666</nova:project>
Nov 08 22:20:10 user nova-compute[75993]:       </nova:owner>
Nov 08 22:20:10 user nova-compute[75993]:       <nova:ports>
Nov 08 22:20:10 user nova-compute[75993]:         <nova:port uuid="436c711e-5c99-49b7-8df9-a1e1d5924b10">
Nov 08 22:20:10 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 08 22:20:10 user nova-compute[75993]:         </nova:port>
Nov 08 22:20:10 user nova-compute[75993]:       </nova:ports>
Nov 08 22:20:10 user nova-compute[75993]:     </nova:instance>
Nov 08 22:20:10 user nova-compute[75993]:   </metadata>
Nov 08 22:20:10 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:20:10 user nova-compute[75993]:     <system>
Nov 08 22:20:10 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:20:10 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:20:10 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:20:10 user nova-compute[75993]:       <entry name="serial">0673e053-a814-4a5e-bf67-d31f07b0c194</entry>
Nov 08 22:20:10 user nova-compute[75993]:       <entry name="uuid">0673e053-a814-4a5e-bf67-d31f07b0c194</entry>
Nov 08 22:20:10 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:20:10 user nova-compute[75993]:     </system>
Nov 08 22:20:10 user nova-compute[75993]:   </sysinfo>
Nov 08 22:20:10 user nova-compute[75993]:   <os>
Nov 08 22:20:10 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:20:10 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:20:10 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:20:10 user nova-compute[75993]:   </os>
Nov 08 22:20:10 user nova-compute[75993]:   <features>
Nov 08 22:20:10 user nova-compute[75993]:     <acpi/>
Nov 08 22:20:10 user nova-compute[75993]:     <apic/>
Nov 08 22:20:10 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:20:10 user nova-compute[75993]:   </features>
Nov 08 22:20:10 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:20:10 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:20:10 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:20:10 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:20:10 user nova-compute[75993]:   </clock>
Nov 08 22:20:10 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:20:10 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:20:10 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:20:10 user nova-compute[75993]:   </cpu>
Nov 08 22:20:10 user nova-compute[75993]:   <devices>
Nov 08 22:20:10 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 22:20:10 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:20:10 user nova-compute[75993]:       <source dev="/dev/sdb"/>
Nov 08 22:20:10 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:20:10 user nova-compute[75993]:       <serial>43e75452-5211-4d7e-a96f-a83b7c76953d</serial>
Nov 08 22:20:10 user nova-compute[75993]:     </disk>
Nov 08 22:20:10 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:20:10 user nova-compute[75993]:       <mac address="fa:16:3e:51:b7:a8"/>
Nov 08 22:20:10 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:20:10 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:20:10 user nova-compute[75993]:       <target dev="tap436c711e-5c"/>
Nov 08 22:20:10 user nova-compute[75993]:     </interface>
Nov 08 22:20:10 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:20:10 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/0673e053-a814-4a5e-bf67-d31f07b0c194/console.log" append="off"/>
Nov 08 22:20:10 user nova-compute[75993]:     </serial>
Nov 08 22:20:10 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:20:10 user nova-compute[75993]:     <video>
Nov 08 22:20:10 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:20:10 user nova-compute[75993]:     </video>
Nov 08 22:20:10 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:20:10 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:20:10 user nova-compute[75993]:     </rng>
Nov 08 22:20:10 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:20:10 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:20:10 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:20:10 user nova-compute[75993]:     </memballoon>
Nov 08 22:20:10 user nova-compute[75993]:   </devices>
Nov 08 22:20:10 user nova-compute[75993]: </domain>
Nov 08 22:20:10 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1065517061',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1065517061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1065517061',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKll+7UmEWvkcTqIUYq60MWgpkVhK5xUTclcdrt9+QUOna6phFQ72FCVbrhoXRTnsDPnpWfVeFsYunw9J1iXtWUWdYKI8O51144UipUFnrLayJVOjWzbXEUoTxh9j7Gmcw==',key_name='tempest-keypair-1719145441',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-jmvua2mu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:19:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=0673e053-a814-4a5e-bf67-d31f07b0c194,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=436c711e-5c99-49b7-8df9-a1e1d5924b10,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c711e-5c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG os_vif [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=436c711e-5c99-49b7-8df9-a1e1d5924b10,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c711e-5c') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3b589c1-7c12-5011-9c67-4d92c663f726', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap436c711e-5c, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap436c711e-5c, col_values=(('qos', UUID('e8243490-c8fa-4f10-9a26-4477072eda1c')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap436c711e-5c, col_values=(('external_ids', {'iface-id': '436c711e-5c99-49b7-8df9-a1e1d5924b10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:b7:a8', 'vm-uuid': '0673e053-a814-4a5e-bf67-d31f07b0c194'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:10 user nova-compute[75993]: INFO os_vif [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=436c711e-5c99-49b7-8df9-a1e1d5924b10,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c711e-5c')
Nov 08 22:20:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:20:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No VIF found with MAC fa:16:3e:51:b7:a8, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:20:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-2a5c37f4-1c66-4e73-b94c-7accc50b0c7f req-187bdae6-94f8-47bd-bd0a-aa2547badd3b service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:20:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2a5c37f4-1c66-4e73-b94c-7accc50b0c7f req-187bdae6-94f8-47bd-bd0a-aa2547badd3b service nova] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:20:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2a5c37f4-1c66-4e73-b94c-7accc50b0c7f req-187bdae6-94f8-47bd-bd0a-aa2547badd3b service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:20:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2a5c37f4-1c66-4e73-b94c-7accc50b0c7f req-187bdae6-94f8-47bd-bd0a-aa2547badd3b service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:20:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-2a5c37f4-1c66-4e73-b94c-7accc50b0c7f req-187bdae6-94f8-47bd-bd0a-aa2547badd3b service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] No waiting events found dispatching network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:20:12 user nova-compute[75993]: WARNING nova.compute.manager [req-2a5c37f4-1c66-4e73-b94c-7accc50b0c7f req-187bdae6-94f8-47bd-bd0a-aa2547badd3b service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received unexpected event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 for instance with vm_state building and task_state spawning.
Nov 08 22:20:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:20:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Instance spawned successfully.
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:20:14 user nova-compute[75993]: INFO nova.compute.manager [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:20:14 user nova-compute[75993]: INFO nova.compute.manager [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Took 27.51 seconds to build instance.
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-db9a40da-c6f9-4f46-8409-1e8af61a9f28 req-09827e51-3b05-4708-8141-f1556cd1849e service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-db9a40da-c6f9-4f46-8409-1e8af61a9f28 req-09827e51-3b05-4708-8141-f1556cd1849e service nova] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-db9a40da-c6f9-4f46-8409-1e8af61a9f28 req-09827e51-3b05-4708-8141-f1556cd1849e service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-db9a40da-c6f9-4f46-8409-1e8af61a9f28 req-09827e51-3b05-4708-8141-f1556cd1849e service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:20:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-db9a40da-c6f9-4f46-8409-1e8af61a9f28 req-09827e51-3b05-4708-8141-f1556cd1849e service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] No waiting events found dispatching network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:20:14 user nova-compute[75993]: WARNING nova.compute.manager [req-db9a40da-c6f9-4f46-8409-1e8af61a9f28 req-09827e51-3b05-4708-8141-f1556cd1849e service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received unexpected event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 for instance with vm_state active and task_state None.
Nov 08 22:20:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c40b6063-18c3-422d-bdf9-1171b28e4585 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.606s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:20:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:20:27 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:29 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:20:29 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:20:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:20:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:20:29 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:20:29 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 7486651d-b863-403c-9118-c366a4e3e9e0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:20:30 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updating instance_info_cache with network_info: [{"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:20:30 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:20:30 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:20:30 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:20:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:20:32 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:20:33 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:20:33 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8789MB free_disk=24.967884063720703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7486651d-b863-403c-9118-c366a4e3e9e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0673e053-a814-4a5e-bf67-d31f07b0c194 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:20:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.429s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:20:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:37 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:37 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:20:40 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 22:20:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:42 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 22:20:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 22:20:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:20:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:20:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-eb25068c-3655-462d-bd6b-3e6b3d450517 req-7b17b864-78df-4156-9290-eb4325ec496a service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-changed-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:20:56 user nova-compute[75993]: DEBUG nova.compute.manager [req-eb25068c-3655-462d-bd6b-3e6b3d450517 req-7b17b864-78df-4156-9290-eb4325ec496a service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Refreshing instance network info cache due to event network-changed-19d4d016-2f33-4fe5-a283-93994869bc57. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:20:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eb25068c-3655-462d-bd6b-3e6b3d450517 req-7b17b864-78df-4156-9290-eb4325ec496a service nova] Acquiring lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:20:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eb25068c-3655-462d-bd6b-3e6b3d450517 req-7b17b864-78df-4156-9290-eb4325ec496a service nova] Acquired lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:20:56 user nova-compute[75993]: DEBUG nova.network.neutron [req-eb25068c-3655-462d-bd6b-3e6b3d450517 req-7b17b864-78df-4156-9290-eb4325ec496a service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Refreshing network info cache for port 19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:20:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:20:57 user nova-compute[75993]: DEBUG nova.network.neutron [req-eb25068c-3655-462d-bd6b-3e6b3d450517 req-7b17b864-78df-4156-9290-eb4325ec496a service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updated VIF entry in instance network info cache for port 19d4d016-2f33-4fe5-a283-93994869bc57. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:20:57 user nova-compute[75993]: DEBUG nova.network.neutron [req-eb25068c-3655-462d-bd6b-3e6b3d450517 req-7b17b864-78df-4156-9290-eb4325ec496a service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updating instance_info_cache with network_info: [{"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:20:57 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eb25068c-3655-462d-bd6b-3e6b3d450517 req-7b17b864-78df-4156-9290-eb4325ec496a service nova] Releasing lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:21:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:02 user nova-compute[75993]: DEBUG nova.objects.instance [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'flavor' on Instance uuid 7486651d-b863-403c-9118-c366a4e3e9e0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:21:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:02 user nova-compute[75993]: INFO nova.compute.manager [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Attaching volume dfc4a7b7-065d-4969-9200-1400fc435647 to /dev/vdb
Nov 08 22:21:02 user nova-compute[75993]: DEBUG os_brick.utils [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:21:02 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e7ea88-24f4-4f73-9876-81acb663b463]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[82308e47-6cb8-456a-afe8-530c021f7333]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb49149-ffe3-4faf-91b4-22d61ed53480]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[32409deb-3508-4376-abc8-435e9215f5d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:21:03 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:21:03 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e415e6-6b0a-4a37-8232-e38b997a2a1e]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG os_brick.utils [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:21:03 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updating existing volume attachment record: 62b16c6b-d816-42bd-bd65-12e8ab2a1473 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:21:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:10 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:21:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 7486651d-b863-403c-9118-c366a4e3e9e0 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:21:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 0673e053-a814-4a5e-bf67-d31f07b0c194 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:21:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:21:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:21:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:21:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:21:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:21:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:21:31 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:21:31 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Updating instance_info_cache with network_info: [{"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:21:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:21:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:21:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:21:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:33 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:21:33 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:21:34 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:21:34 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:21:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:34 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:21:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:21:35 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:21:35 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:21:35 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=24.966815948486328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7486651d-b863-403c-9118-c366a4e3e9e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0673e053-a814-4a5e-bf67-d31f07b0c194 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsxjYGIv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:21:36 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:21:36 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:21:36 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99c3057-55d6-41fd-ad96-22025379ceef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:21:36 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f79fac1-eaf5-4588-82ea-45182e8397db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647] added
Nov 08 22:21:36 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aea8f9-d71b-4ef9-99f0-c3c6a6c90d8a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c09147-e224-48cb-bf7a-861bf1334192]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LsxjYGIv {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LsxjYGIv" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[51557dd3-ea43-4822-99e7-9389cb39e2fb]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LsxjYGIv'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6239ef27-00ca-4214-9ffd-004ec6e976fd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8c7f88-4292-465b-a117-ba2d18fd3413]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:21:36 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:21:36 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d85ab4-9a57-4048-a699-ec94f779609e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647, portal: 172.16.0.220,3260]
Nov 08 22:21:36 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647, portal: 172.16.0.220,3260] successful.
Nov 08 22:21:36 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2b0224-4ef9-4cc1-af63-e968b3325b5b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfd2a0a-30ea-4497-af32-a1f88f1e5e17]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:21:36 user nova-compute[75993]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)
Nov 08 22:21:36 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:21:36 user nova-compute[75993]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)
Nov 08 22:21:36 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d68b54a-521e-4b6a-ab14-cd77b9c36a5f]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:21:36 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsxjYGIv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26232633861633838', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232633861633838', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG nova.objects.instance [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'flavor' on Instance uuid 7486651d-b863-403c-9118-c366a4e3e9e0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 22:21:37 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:21:37 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 22:21:37 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:21:37 user nova-compute[75993]:   <serial>dfc4a7b7-065d-4969-9200-1400fc435647</serial>
Nov 08 22:21:37 user nova-compute[75993]: </disk>
Nov 08 22:21:37 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-ebccf409-e6e8-4de2-a374-044b17a2220a req-c46a7a36-25bb-4620-92df-fae7e7330fb9 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-changed-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG nova.compute.manager [req-ebccf409-e6e8-4de2-a374-044b17a2220a req-c46a7a36-25bb-4620-92df-fae7e7330fb9 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Refreshing instance network info cache due to event network-changed-436c711e-5c99-49b7-8df9-a1e1d5924b10. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ebccf409-e6e8-4de2-a374-044b17a2220a req-c46a7a36-25bb-4620-92df-fae7e7330fb9 service nova] Acquiring lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ebccf409-e6e8-4de2-a374-044b17a2220a req-c46a7a36-25bb-4620-92df-fae7e7330fb9 service nova] Acquired lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:21:37 user nova-compute[75993]: DEBUG nova.network.neutron [req-ebccf409-e6e8-4de2-a374-044b17a2220a req-c46a7a36-25bb-4620-92df-fae7e7330fb9 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Refreshing network info cache for port 436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:21:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:21:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:21:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No VIF found with MAC fa:16:3e:ea:e9:d8, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:21:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-46043397-4f51-4067-9fe7-bb3b6bac005e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.236s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 27.566s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:38 user nova-compute[75993]: DEBUG nova.network.neutron [req-ebccf409-e6e8-4de2-a374-044b17a2220a req-c46a7a36-25bb-4620-92df-fae7e7330fb9 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Updated VIF entry in instance network info cache for port 436c711e-5c99-49b7-8df9-a1e1d5924b10. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:21:38 user nova-compute[75993]: DEBUG nova.network.neutron [req-ebccf409-e6e8-4de2-a374-044b17a2220a req-c46a7a36-25bb-4620-92df-fae7e7330fb9 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Updating instance_info_cache with network_info: [{"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:21:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ebccf409-e6e8-4de2-a374-044b17a2220a req-c46a7a36-25bb-4620-92df-fae7e7330fb9 service nova] Releasing lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:21:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "c416012d-2a15-4c77-a959-6e51d72fc94e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:21:41 user nova-compute[75993]: INFO nova.compute.claims [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Claim successful on node user
Nov 08 22:21:41 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.264s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:21:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:21:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG nova.policy [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be86d9fb78614dbeaaf9faa42bbf2868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8260793f85b4fa7a83c779f7f6c58e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:21:41 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Creating image(s)
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "/opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "/opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "/opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.210s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk 1073741824" returned: 0 in 0.063s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.188s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Cannot resize image /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Ensure instance console log exists: /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:42 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Successfully created port: e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Successfully updated port: e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "refresh_cache-c416012d-2a15-4c77-a959-6e51d72fc94e" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquired lock "refresh_cache-c416012d-2a15-4c77-a959-6e51d72fc94e" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-da4c55ad-029a-4e2c-a7f0-64630bb75941 req-5f074c9f-f98d-4b6f-afbd-af77501d264a service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-changed-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-da4c55ad-029a-4e2c-a7f0-64630bb75941 req-5f074c9f-f98d-4b6f-afbd-af77501d264a service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Refreshing instance network info cache due to event network-changed-e7cdecb7-cc49-44df-88cb-f73a38f9c157. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-da4c55ad-029a-4e2c-a7f0-64630bb75941 req-5f074c9f-f98d-4b6f-afbd-af77501d264a service nova] Acquiring lock "refresh_cache-c416012d-2a15-4c77-a959-6e51d72fc94e" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Updating instance_info_cache with network_info: [{"id": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "address": "fa:16:3e:9c:eb:bf", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7cdecb7-cc", "ovs_interfaceid": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Releasing lock "refresh_cache-c416012d-2a15-4c77-a959-6e51d72fc94e" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Instance network_info: |[{"id": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "address": "fa:16:3e:9c:eb:bf", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7cdecb7-cc", "ovs_interfaceid": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-da4c55ad-029a-4e2c-a7f0-64630bb75941 req-5f074c9f-f98d-4b6f-afbd-af77501d264a service nova] Acquired lock "refresh_cache-c416012d-2a15-4c77-a959-6e51d72fc94e" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-da4c55ad-029a-4e2c-a7f0-64630bb75941 req-5f074c9f-f98d-4b6f-afbd-af77501d264a service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Refreshing network info cache for port e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Start _get_guest_xml network_info=[{"id": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "address": "fa:16:3e:9c:eb:bf", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7cdecb7-cc", "ovs_interfaceid": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:21:43 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:21:43 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-288770879',display_name='tempest-AttachVolumeNegativeTest-server-288770879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-288770879',id=45,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZXsxPT9Ib1a6sFMHdFBgu4Sq7wexWN5KowY6pxdJl8YbVkjOruzJLM42Z9jAJx8zpqxMDt5qibKyiP8FRR410tVa4qvVjwCex/15bwX8gwxBkZTNFCLJf8lE/6xq5rQ==',key_name='tempest-keypair-2041106199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-by0545pi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=c416012d-2a15-4c77-a959-6e51d72fc94e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "address": "fa:16:3e:9c:eb:bf", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7cdecb7-cc", "ovs_interfaceid": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "address": "fa:16:3e:9c:eb:bf", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7cdecb7-cc", "ovs_interfaceid": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:eb:bf,bridge_name='br-int',has_traffic_filtering=True,id=e7cdecb7-cc49-44df-88cb-f73a38f9c157,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7cdecb7-cc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.objects.instance [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'pci_devices' on Instance uuid c416012d-2a15-4c77-a959-6e51d72fc94e {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:21:43 user nova-compute[75993]:   <uuid>c416012d-2a15-4c77-a959-6e51d72fc94e</uuid>
Nov 08 22:21:43 user nova-compute[75993]:   <name>instance-0000002d</name>
Nov 08 22:21:43 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:21:43 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:21:43 user nova-compute[75993]:   <metadata>
Nov 08 22:21:43 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:21:43 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:21:43 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeNegativeTest-server-288770879</nova:name>
Nov 08 22:21:43 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:21:43</nova:creationTime>
Nov 08 22:21:43 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:21:43 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:21:43 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:21:43 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:21:43 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:21:43 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:21:43 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:21:43 user nova-compute[75993]:       <nova:owner>
Nov 08 22:21:43 user nova-compute[75993]:         <nova:user uuid="be86d9fb78614dbeaaf9faa42bbf2868">tempest-AttachVolumeNegativeTest-1149565506-project-member</nova:user>
Nov 08 22:21:43 user nova-compute[75993]:         <nova:project uuid="b8260793f85b4fa7a83c779f7f6c58e3">tempest-AttachVolumeNegativeTest-1149565506</nova:project>
Nov 08 22:21:43 user nova-compute[75993]:       </nova:owner>
Nov 08 22:21:43 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 22:21:43 user nova-compute[75993]:       <nova:ports>
Nov 08 22:21:43 user nova-compute[75993]:         <nova:port uuid="e7cdecb7-cc49-44df-88cb-f73a38f9c157">
Nov 08 22:21:43 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 08 22:21:43 user nova-compute[75993]:         </nova:port>
Nov 08 22:21:43 user nova-compute[75993]:       </nova:ports>
Nov 08 22:21:43 user nova-compute[75993]:     </nova:instance>
Nov 08 22:21:43 user nova-compute[75993]:   </metadata>
Nov 08 22:21:43 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:21:43 user nova-compute[75993]:     <system>
Nov 08 22:21:43 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:21:43 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:21:43 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:21:43 user nova-compute[75993]:       <entry name="serial">c416012d-2a15-4c77-a959-6e51d72fc94e</entry>
Nov 08 22:21:43 user nova-compute[75993]:       <entry name="uuid">c416012d-2a15-4c77-a959-6e51d72fc94e</entry>
Nov 08 22:21:43 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:21:43 user nova-compute[75993]:     </system>
Nov 08 22:21:43 user nova-compute[75993]:   </sysinfo>
Nov 08 22:21:43 user nova-compute[75993]:   <os>
Nov 08 22:21:43 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:21:43 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:21:43 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:21:43 user nova-compute[75993]:   </os>
Nov 08 22:21:43 user nova-compute[75993]:   <features>
Nov 08 22:21:43 user nova-compute[75993]:     <acpi/>
Nov 08 22:21:43 user nova-compute[75993]:     <apic/>
Nov 08 22:21:43 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:21:43 user nova-compute[75993]:   </features>
Nov 08 22:21:43 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:21:43 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:21:43 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:21:43 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:21:43 user nova-compute[75993]:   </clock>
Nov 08 22:21:43 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:21:43 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:21:43 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:21:43 user nova-compute[75993]:   </cpu>
Nov 08 22:21:43 user nova-compute[75993]:   <devices>
Nov 08 22:21:43 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 22:21:43 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 22:21:43 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk"/>
Nov 08 22:21:43 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:21:43 user nova-compute[75993]:     </disk>
Nov 08 22:21:43 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:21:43 user nova-compute[75993]:       <mac address="fa:16:3e:9c:eb:bf"/>
Nov 08 22:21:43 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:21:43 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:21:43 user nova-compute[75993]:       <target dev="tape7cdecb7-cc"/>
Nov 08 22:21:43 user nova-compute[75993]:     </interface>
Nov 08 22:21:43 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:21:43 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/console.log" append="off"/>
Nov 08 22:21:43 user nova-compute[75993]:     </serial>
Nov 08 22:21:43 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:21:43 user nova-compute[75993]:     <video>
Nov 08 22:21:43 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:21:43 user nova-compute[75993]:     </video>
Nov 08 22:21:43 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:21:43 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:21:43 user nova-compute[75993]:     </rng>
Nov 08 22:21:43 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:21:43 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:21:43 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:21:43 user nova-compute[75993]:     </memballoon>
Nov 08 22:21:43 user nova-compute[75993]:   </devices>
Nov 08 22:21:43 user nova-compute[75993]: </domain>
Nov 08 22:21:43 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-288770879',display_name='tempest-AttachVolumeNegativeTest-server-288770879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-288770879',id=45,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZXsxPT9Ib1a6sFMHdFBgu4Sq7wexWN5KowY6pxdJl8YbVkjOruzJLM42Z9jAJx8zpqxMDt5qibKyiP8FRR410tVa4qvVjwCex/15bwX8gwxBkZTNFCLJf8lE/6xq5rQ==',key_name='tempest-keypair-2041106199',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-by0545pi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=c416012d-2a15-4c77-a959-6e51d72fc94e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "address": "fa:16:3e:9c:eb:bf", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7cdecb7-cc", "ovs_interfaceid": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "address": "fa:16:3e:9c:eb:bf", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7cdecb7-cc", "ovs_interfaceid": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:eb:bf,bridge_name='br-int',has_traffic_filtering=True,id=e7cdecb7-cc49-44df-88cb-f73a38f9c157,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7cdecb7-cc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG os_vif [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:eb:bf,bridge_name='br-int',has_traffic_filtering=True,id=e7cdecb7-cc49-44df-88cb-f73a38f9c157,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7cdecb7-cc') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff74ee06-567f-55e4-b3e0-4e05fe8241f9', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7cdecb7-cc, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7cdecb7-cc, col_values=(('qos', UUID('d7c3fc61-1912-4f98-83ca-b5668cdd3342')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7cdecb7-cc, col_values=(('external_ids', {'iface-id': 'e7cdecb7-cc49-44df-88cb-f73a38f9c157', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:eb:bf', 'vm-uuid': 'c416012d-2a15-4c77-a959-6e51d72fc94e'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:43 user nova-compute[75993]: INFO os_vif [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:eb:bf,bridge_name='br-int',has_traffic_filtering=True,id=e7cdecb7-cc49-44df-88cb-f73a38f9c157,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7cdecb7-cc')
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No VIF found with MAC fa:16:3e:9c:eb:bf, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-da4c55ad-029a-4e2c-a7f0-64630bb75941 req-5f074c9f-f98d-4b6f-afbd-af77501d264a service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Updated VIF entry in instance network info cache for port e7cdecb7-cc49-44df-88cb-f73a38f9c157. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-da4c55ad-029a-4e2c-a7f0-64630bb75941 req-5f074c9f-f98d-4b6f-afbd-af77501d264a service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Updating instance_info_cache with network_info: [{"id": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "address": "fa:16:3e:9c:eb:bf", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7cdecb7-cc", "ovs_interfaceid": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:21:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-da4c55ad-029a-4e2c-a7f0-64630bb75941 req-5f074c9f-f98d-4b6f-afbd-af77501d264a service nova] Releasing lock "refresh_cache-c416012d-2a15-4c77-a959-6e51d72fc94e" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:21:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:21:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-235b239d-ae5a-4f74-b761-3d40383c8cba req-4c8a667c-e7d0-47fe-b4df-1c53df78296f service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:21:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-235b239d-ae5a-4f74-b761-3d40383c8cba req-4c8a667c-e7d0-47fe-b4df-1c53df78296f service nova] Acquiring lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-235b239d-ae5a-4f74-b761-3d40383c8cba req-4c8a667c-e7d0-47fe-b4df-1c53df78296f service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-235b239d-ae5a-4f74-b761-3d40383c8cba req-4c8a667c-e7d0-47fe-b4df-1c53df78296f service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-235b239d-ae5a-4f74-b761-3d40383c8cba req-4c8a667c-e7d0-47fe-b4df-1c53df78296f service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] No waiting events found dispatching network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:21:45 user nova-compute[75993]: WARNING nova.compute.manager [req-235b239d-ae5a-4f74-b761-3d40383c8cba req-4c8a667c-e7d0-47fe-b4df-1c53df78296f service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received unexpected event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 for instance with vm_state building and task_state spawning.
Nov 08 22:21:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:21:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Instance spawned successfully.
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:21:47 user nova-compute[75993]: INFO nova.compute.manager [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-5369739d-04ec-4ef2-a0fb-c9dd732a4643 req-047bfad7-2b6f-4ab0-b039-f386528a9a94 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5369739d-04ec-4ef2-a0fb-c9dd732a4643 req-047bfad7-2b6f-4ab0-b039-f386528a9a94 service nova] Acquiring lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5369739d-04ec-4ef2-a0fb-c9dd732a4643 req-047bfad7-2b6f-4ab0-b039-f386528a9a94 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5369739d-04ec-4ef2-a0fb-c9dd732a4643 req-047bfad7-2b6f-4ab0-b039-f386528a9a94 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-5369739d-04ec-4ef2-a0fb-c9dd732a4643 req-047bfad7-2b6f-4ab0-b039-f386528a9a94 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] No waiting events found dispatching network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:21:47 user nova-compute[75993]: WARNING nova.compute.manager [req-5369739d-04ec-4ef2-a0fb-c9dd732a4643 req-047bfad7-2b6f-4ab0-b039-f386528a9a94 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received unexpected event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 for instance with vm_state building and task_state spawning.
Nov 08 22:21:47 user nova-compute[75993]: INFO nova.compute.manager [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Took 6.08 seconds to build instance.
Nov 08 22:21:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-b4aba423-4411-4506-a8a4-fea15ea12316 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.257s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "dfe019af-f761-4edd-8099-5b635d5e9eb2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:21:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:21:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:21:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:21:53 user nova-compute[75993]: INFO nova.compute.claims [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Claim successful on node user
Nov 08 22:21:53 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:21:53 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:21:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:21:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:21:53 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:21:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:21:53 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:21:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:21:53 user nova-compute[75993]: INFO nova.virt.block_device [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Booting with volume snapshot ace0c00b-d6b2-4dbc-853c-dcfecf606c47 at /dev/vda
Nov 08 22:21:53 user nova-compute[75993]: DEBUG nova.policy [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4d2f038c60247b894c8849ee3b9183b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef08c827c91436bb907130af0c4f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:21:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:21:54 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Successfully created port: 22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:21:54 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Successfully updated port: 22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:21:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "refresh_cache-dfe019af-f761-4edd-8099-5b635d5e9eb2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:21:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquired lock "refresh_cache-dfe019af-f761-4edd-8099-5b635d5e9eb2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:21:54 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:21:54 user nova-compute[75993]: DEBUG nova.compute.manager [req-2943a6b6-b7db-45f6-a6bf-b78c651ed085 req-cab8828d-9623-43a5-bc7d-c744d1144ec0 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Received event network-changed-22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:21:54 user nova-compute[75993]: DEBUG nova.compute.manager [req-2943a6b6-b7db-45f6-a6bf-b78c651ed085 req-cab8828d-9623-43a5-bc7d-c744d1144ec0 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Refreshing instance network info cache due to event network-changed-22cf273c-572a-4f24-9464-266c3cfd19cd. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:21:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2943a6b6-b7db-45f6-a6bf-b78c651ed085 req-cab8828d-9623-43a5-bc7d-c744d1144ec0 service nova] Acquiring lock "refresh_cache-dfe019af-f761-4edd-8099-5b635d5e9eb2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:21:54 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:21:55 user nova-compute[75993]: DEBUG nova.network.neutron [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Updating instance_info_cache with network_info: [{"id": "22cf273c-572a-4f24-9464-266c3cfd19cd", "address": "fa:16:3e:a1:d2:15", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cf273c-57", "ovs_interfaceid": "22cf273c-572a-4f24-9464-266c3cfd19cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:21:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Releasing lock "refresh_cache-dfe019af-f761-4edd-8099-5b635d5e9eb2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:21:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Instance network_info: |[{"id": "22cf273c-572a-4f24-9464-266c3cfd19cd", "address": "fa:16:3e:a1:d2:15", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cf273c-57", "ovs_interfaceid": "22cf273c-572a-4f24-9464-266c3cfd19cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:21:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2943a6b6-b7db-45f6-a6bf-b78c651ed085 req-cab8828d-9623-43a5-bc7d-c744d1144ec0 service nova] Acquired lock "refresh_cache-dfe019af-f761-4edd-8099-5b635d5e9eb2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:21:55 user nova-compute[75993]: DEBUG nova.network.neutron [req-2943a6b6-b7db-45f6-a6bf-b78c651ed085 req-cab8828d-9623-43a5-bc7d-c744d1144ec0 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Refreshing network info cache for port 22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:21:55 user nova-compute[75993]: DEBUG nova.network.neutron [req-2943a6b6-b7db-45f6-a6bf-b78c651ed085 req-cab8828d-9623-43a5-bc7d-c744d1144ec0 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Updated VIF entry in instance network info cache for port 22cf273c-572a-4f24-9464-266c3cfd19cd. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:21:55 user nova-compute[75993]: DEBUG nova.network.neutron [req-2943a6b6-b7db-45f6-a6bf-b78c651ed085 req-cab8828d-9623-43a5-bc7d-c744d1144ec0 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Updating instance_info_cache with network_info: [{"id": "22cf273c-572a-4f24-9464-266c3cfd19cd", "address": "fa:16:3e:a1:d2:15", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cf273c-57", "ovs_interfaceid": "22cf273c-572a-4f24-9464-266c3cfd19cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:21:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2943a6b6-b7db-45f6-a6bf-b78c651ed085 req-cab8828d-9623-43a5-bc7d-c744d1144ec0 service nova] Releasing lock "refresh_cache-dfe019af-f761-4edd-8099-5b635d5e9eb2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:21:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG os_brick.utils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b8e9bd-290c-489b-a137-b6ae2eb19696]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66c4924-2d73-4650-bcbb-c018327e36eb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[795790ca-160c-41af-9c3d-e0ed559bcf1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d875b82-1f00-43c5-9bc2-75ec592eced0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:21:59 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:21:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f54791-ad59-443a-afd6-9f658c2bacb1]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG os_brick.utils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:21:59 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Updating existing volume attachment record: 24d740b2-d7e7-44af-8bea-ff1d81d40c81 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:22:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:22:22 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Creating image(s)
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Ensure instance console log exists: /opt/stack/data/nova/instances/dfe019af-f761-4edd-8099-5b635d5e9eb2/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Start _get_guest_xml network_info=[{"id": "22cf273c-572a-4f24-9464-266c3cfd19cd", "address": "fa:16:3e:a1:d2:15", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cf273c-57", "ovs_interfaceid": "22cf273c-572a-4f24-9464-266c3cfd19cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T22:21:39Z,direct_url=<?>,disk_format='qcow2',id=5e784ecf-6f1f-431f-acc6-f1ecb00ab34a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-416366583',owner='9ef08c827c91436bb907130af0c4f031',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T22:21:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '24d740b2-d7e7-44af-8bea-ff1d81d40c81', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMtBwFuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dfe019af-f761-4edd-8099-5b635d5e9eb2', 'attached_at': '', 'detached_at': '', 'volume_id': '2c42442f-22f8-4a5b-8fdb-77af4510321c', 'serial': '2c42442f-22f8-4a5b-8fdb-77af4510321c'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:22:22 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:22:22 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-08T22:21:39Z,direct_url=<?>,disk_format='qcow2',id=5e784ecf-6f1f-431f-acc6-f1ecb00ab34a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-416366583',owner='9ef08c827c91436bb907130af0c4f031',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-08T22:21:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMtBwFuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:22:22 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:22:22 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:22:22 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c723f4b-be6e-47d9-9614-e4d4d29521b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:22:22 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bd3a13-07e6-4867-a823-66949e457e2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c] added
Nov 08 22:22:22 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eb520f-e74d-4a38-9ca3-5bf07cbb1080]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[58268713-74e6-430a-bd49-d89600746b63]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMtBwFuR {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMtBwFuR" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff575530-427a-4118-a814-ba54034c51ed]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GMtBwFuR'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7e5788-7091-43f8-85d5-8c86748cdd2d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d07452b-a85d-47fd-9b32-ccff99ed95c2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:22:22 user nova-compute[75993]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)
Nov 08 22:22:22 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:22:22 user nova-compute[75993]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)
Nov 08 22:22:22 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec83f40b-25a0-47bb-bd99-24ee1d0553ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c, portal: 172.16.0.220,3260]
Nov 08 22:22:22 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c, portal: 172.16.0.220,3260] successful.
Nov 08 22:22:22 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1ed3db-dcce-4c59-bd5c-06ed1be25040]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ab852f-3e61-465b-b8b7-0f8cb4fe94ef]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:22:22 user nova-compute[75993]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)
Nov 08 22:22:22 user nova-compute[75993]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c (non-flash)
Nov 08 22:22:22 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:22:22 user nova-compute[75993]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)
Nov 08 22:22:22 user nova-compute[75993]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c (non-flash)
Nov 08 22:22:22 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa76f880-c6cb-476f-a314-66b91c494aeb]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:22:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMtBwFuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '26264656165663464', 'path': '/dev/sdd'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26264656165663464', 'path': '/dev/sdd'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-509623729',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-509623729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-509623729',id=46,image_ref='5e784ecf-6f1f-431f-acc6-f1ecb00ab34a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw4RW2+vHlCFh5+f4BT9uYba+rjlbGAuEabbwSLH8bHoxOXaEAZTnfkY8Px25T29Csl0jNKq6uQCIhO7yD5YssPmKCdpxpL2FFCq5UTGK7OTy8VNvNpDbegNgim83n5yg==',key_name='tempest-keypair-1620080344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-lxbqyxud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1717039666',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=dfe019af-f761-4edd-8099-5b635d5e9eb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22cf273c-572a-4f24-9464-266c3cfd19cd", "address": "fa:16:3e:a1:d2:15", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cf273c-57", "ovs_interfaceid": "22cf273c-572a-4f24-9464-266c3cfd19cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "22cf273c-572a-4f24-9464-266c3cfd19cd", "address": "fa:16:3e:a1:d2:15", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cf273c-57", "ovs_interfaceid": "22cf273c-572a-4f24-9464-266c3cfd19cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=22cf273c-572a-4f24-9464-266c3cfd19cd,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cf273c-57') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG nova.objects.instance [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'pci_devices' on Instance uuid dfe019af-f761-4edd-8099-5b635d5e9eb2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:22:23 user nova-compute[75993]:   <uuid>dfe019af-f761-4edd-8099-5b635d5e9eb2</uuid>
Nov 08 22:22:23 user nova-compute[75993]:   <name>instance-0000002e</name>
Nov 08 22:22:23 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:22:23 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:22:23 user nova-compute[75993]:   <metadata>
Nov 08 22:22:23 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:22:23 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:22:23 user nova-compute[75993]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-509623729</nova:name>
Nov 08 22:22:23 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:22:22</nova:creationTime>
Nov 08 22:22:23 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:22:23 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:22:23 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:22:23 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:22:23 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:22:23 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:22:23 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:22:23 user nova-compute[75993]:       <nova:owner>
Nov 08 22:22:23 user nova-compute[75993]:         <nova:user uuid="e4d2f038c60247b894c8849ee3b9183b">tempest-TestVolumeBootPattern-1717039666-project-member</nova:user>
Nov 08 22:22:23 user nova-compute[75993]:         <nova:project uuid="9ef08c827c91436bb907130af0c4f031">tempest-TestVolumeBootPattern-1717039666</nova:project>
Nov 08 22:22:23 user nova-compute[75993]:       </nova:owner>
Nov 08 22:22:23 user nova-compute[75993]:       <nova:root type="image" uuid="5e784ecf-6f1f-431f-acc6-f1ecb00ab34a"/>
Nov 08 22:22:23 user nova-compute[75993]:       <nova:ports>
Nov 08 22:22:23 user nova-compute[75993]:         <nova:port uuid="22cf273c-572a-4f24-9464-266c3cfd19cd">
Nov 08 22:22:23 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 08 22:22:23 user nova-compute[75993]:         </nova:port>
Nov 08 22:22:23 user nova-compute[75993]:       </nova:ports>
Nov 08 22:22:23 user nova-compute[75993]:     </nova:instance>
Nov 08 22:22:23 user nova-compute[75993]:   </metadata>
Nov 08 22:22:23 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:22:23 user nova-compute[75993]:     <system>
Nov 08 22:22:23 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:22:23 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:22:23 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:22:23 user nova-compute[75993]:       <entry name="serial">dfe019af-f761-4edd-8099-5b635d5e9eb2</entry>
Nov 08 22:22:23 user nova-compute[75993]:       <entry name="uuid">dfe019af-f761-4edd-8099-5b635d5e9eb2</entry>
Nov 08 22:22:23 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:22:23 user nova-compute[75993]:     </system>
Nov 08 22:22:23 user nova-compute[75993]:   </sysinfo>
Nov 08 22:22:23 user nova-compute[75993]:   <os>
Nov 08 22:22:23 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:22:23 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:22:23 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:22:23 user nova-compute[75993]:   </os>
Nov 08 22:22:23 user nova-compute[75993]:   <features>
Nov 08 22:22:23 user nova-compute[75993]:     <acpi/>
Nov 08 22:22:23 user nova-compute[75993]:     <apic/>
Nov 08 22:22:23 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:22:23 user nova-compute[75993]:   </features>
Nov 08 22:22:23 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:22:23 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:22:23 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:22:23 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:22:23 user nova-compute[75993]:   </clock>
Nov 08 22:22:23 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:22:23 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:22:23 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:22:23 user nova-compute[75993]:   </cpu>
Nov 08 22:22:23 user nova-compute[75993]:   <devices>
Nov 08 22:22:23 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 22:22:23 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:22:23 user nova-compute[75993]:       <source dev="/dev/sdd"/>
Nov 08 22:22:23 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:22:23 user nova-compute[75993]:       <serial>2c42442f-22f8-4a5b-8fdb-77af4510321c</serial>
Nov 08 22:22:23 user nova-compute[75993]:     </disk>
Nov 08 22:22:23 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:22:23 user nova-compute[75993]:       <mac address="fa:16:3e:a1:d2:15"/>
Nov 08 22:22:23 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:22:23 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:22:23 user nova-compute[75993]:       <target dev="tap22cf273c-57"/>
Nov 08 22:22:23 user nova-compute[75993]:     </interface>
Nov 08 22:22:23 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:22:23 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/dfe019af-f761-4edd-8099-5b635d5e9eb2/console.log" append="off"/>
Nov 08 22:22:23 user nova-compute[75993]:     </serial>
Nov 08 22:22:23 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:22:23 user nova-compute[75993]:     <video>
Nov 08 22:22:23 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:22:23 user nova-compute[75993]:     </video>
Nov 08 22:22:23 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:22:23 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:22:23 user nova-compute[75993]:     </rng>
Nov 08 22:22:23 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:22:23 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:22:23 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:22:23 user nova-compute[75993]:     </memballoon>
Nov 08 22:22:23 user nova-compute[75993]:   </devices>
Nov 08 22:22:23 user nova-compute[75993]: </domain>
Nov 08 22:22:23 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-509623729',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-509623729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-509623729',id=46,image_ref='5e784ecf-6f1f-431f-acc6-f1ecb00ab34a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw4RW2+vHlCFh5+f4BT9uYba+rjlbGAuEabbwSLH8bHoxOXaEAZTnfkY8Px25T29Csl0jNKq6uQCIhO7yD5YssPmKCdpxpL2FFCq5UTGK7OTy8VNvNpDbegNgim83n5yg==',key_name='tempest-keypair-1620080344',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-lxbqyxud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1717039666',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:21:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=dfe019af-f761-4edd-8099-5b635d5e9eb2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22cf273c-572a-4f24-9464-266c3cfd19cd", "address": "fa:16:3e:a1:d2:15", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cf273c-57", "ovs_interfaceid": "22cf273c-572a-4f24-9464-266c3cfd19cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "22cf273c-572a-4f24-9464-266c3cfd19cd", "address": "fa:16:3e:a1:d2:15", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cf273c-57", "ovs_interfaceid": "22cf273c-572a-4f24-9464-266c3cfd19cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=22cf273c-572a-4f24-9464-266c3cfd19cd,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cf273c-57') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG os_vif [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=22cf273c-572a-4f24-9464-266c3cfd19cd,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cf273c-57') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '953e02c3-2aa6-501a-8b68-791430968f55', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22cf273c-57, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22cf273c-57, col_values=(('qos', UUID('18b40842-76d1-4c1d-aafb-5664fb8b0409')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22cf273c-57, col_values=(('external_ids', {'iface-id': '22cf273c-572a-4f24-9464-266c3cfd19cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:d2:15', 'vm-uuid': 'dfe019af-f761-4edd-8099-5b635d5e9eb2'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:23 user nova-compute[75993]: INFO os_vif [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=22cf273c-572a-4f24-9464-266c3cfd19cd,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cf273c-57')
Nov 08 22:22:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:22:23 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No VIF found with MAC fa:16:3e:a1:d2:15, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:22:24 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:22:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-513771b0-e970-44d9-a29f-4074fae0ae52 req-e0450022-609f-4f9e-bb2f-9b8397d2f233 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Received event network-vif-plugged-22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:22:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-513771b0-e970-44d9-a29f-4074fae0ae52 req-e0450022-609f-4f9e-bb2f-9b8397d2f233 service nova] Acquiring lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:22:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-513771b0-e970-44d9-a29f-4074fae0ae52 req-e0450022-609f-4f9e-bb2f-9b8397d2f233 service nova] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:22:25 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-513771b0-e970-44d9-a29f-4074fae0ae52 req-e0450022-609f-4f9e-bb2f-9b8397d2f233 service nova] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:22:25 user nova-compute[75993]: DEBUG nova.compute.manager [req-513771b0-e970-44d9-a29f-4074fae0ae52 req-e0450022-609f-4f9e-bb2f-9b8397d2f233 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] No waiting events found dispatching network-vif-plugged-22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:22:25 user nova-compute[75993]: WARNING nova.compute.manager [req-513771b0-e970-44d9-a29f-4074fae0ae52 req-e0450022-609f-4f9e-bb2f-9b8397d2f233 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Received unexpected event network-vif-plugged-22cf273c-572a-4f24-9464-266c3cfd19cd for instance with vm_state building and task_state spawning.
Nov 08 22:22:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:22:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:22:27 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Instance spawned successfully.
Nov 08 22:22:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:22:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:22:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:22:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-094e56b8-40fb-4c32-b2a7-dc21dffbab19 req-b0d39dc8-af97-454b-9404-99555a99390b service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Received event network-vif-plugged-22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:22:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-094e56b8-40fb-4c32-b2a7-dc21dffbab19 req-b0d39dc8-af97-454b-9404-99555a99390b service nova] Acquiring lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:22:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-094e56b8-40fb-4c32-b2a7-dc21dffbab19 req-b0d39dc8-af97-454b-9404-99555a99390b service nova] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:22:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-094e56b8-40fb-4c32-b2a7-dc21dffbab19 req-b0d39dc8-af97-454b-9404-99555a99390b service nova] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:22:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-094e56b8-40fb-4c32-b2a7-dc21dffbab19 req-b0d39dc8-af97-454b-9404-99555a99390b service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] No waiting events found dispatching network-vif-plugged-22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:22:27 user nova-compute[75993]: WARNING nova.compute.manager [req-094e56b8-40fb-4c32-b2a7-dc21dffbab19 req-b0d39dc8-af97-454b-9404-99555a99390b service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Received unexpected event network-vif-plugged-22cf273c-572a-4f24-9464-266c3cfd19cd for instance with vm_state building and task_state spawning.
Nov 08 22:22:27 user nova-compute[75993]: INFO nova.compute.manager [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Took 4.94 seconds to spawn the instance on the hypervisor.
Nov 08 22:22:27 user nova-compute[75993]: DEBUG nova.compute.manager [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:22:27 user nova-compute[75993]: INFO nova.compute.manager [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Took 34.17 seconds to build instance.
Nov 08 22:22:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-29ac5a2f-0d59-4de4-be35-47fccbb25849 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.263s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:22:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:22:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:22:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:22:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:22:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:22:31 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:22:31 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 7486651d-b863-403c-9118-c366a4e3e9e0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:22:32 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updating instance_info_cache with network_info: [{"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:22:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-7486651d-b863-403c-9118-c366a4e3e9e0" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:22:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:22:33 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:22:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:22:34 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:22:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:22:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:22:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:22:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:22:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:22:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:22:35 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:22:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:35 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:22:36 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:22:36 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:22:36 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8628MB free_disk=24.935665130615234GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7486651d-b863-403c-9118-c366a4e3e9e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0673e053-a814-4a5e-bf67-d31f07b0c194 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance c416012d-2a15-4c77-a959-6e51d72fc94e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance dfe019af-f761-4edd-8099-5b635d5e9eb2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:22:36 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:22:37 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:22:37 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:22:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:22:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:22:39 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:22:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:22:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:22:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:22:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:22:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:23:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:23:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:23:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:23:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:23:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:23:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:26 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:23:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:23:31 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:23:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:23:31 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:23:31 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-d11ff8a0-67de-44a7-b5f0-46ae85e7f138 req-055873ce-4aaf-4e9c-a1ed-7cfc16d23aed service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-changed-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG nova.compute.manager [req-d11ff8a0-67de-44a7-b5f0-46ae85e7f138 req-055873ce-4aaf-4e9c-a1ed-7cfc16d23aed service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Refreshing instance network info cache due to event network-changed-e7cdecb7-cc49-44df-88cb-f73a38f9c157. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d11ff8a0-67de-44a7-b5f0-46ae85e7f138 req-055873ce-4aaf-4e9c-a1ed-7cfc16d23aed service nova] Acquiring lock "refresh_cache-c416012d-2a15-4c77-a959-6e51d72fc94e" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d11ff8a0-67de-44a7-b5f0-46ae85e7f138 req-055873ce-4aaf-4e9c-a1ed-7cfc16d23aed service nova] Acquired lock "refresh_cache-c416012d-2a15-4c77-a959-6e51d72fc94e" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG nova.network.neutron [req-d11ff8a0-67de-44a7-b5f0-46ae85e7f138 req-055873ce-4aaf-4e9c-a1ed-7cfc16d23aed service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Refreshing network info cache for port e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Updating instance_info_cache with network_info: [{"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-0673e053-a814-4a5e-bf67-d31f07b0c194" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "c416012d-2a15-4c77-a959-6e51d72fc94e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG nova.network.neutron [req-d11ff8a0-67de-44a7-b5f0-46ae85e7f138 req-055873ce-4aaf-4e9c-a1ed-7cfc16d23aed service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Updated VIF entry in instance network info cache for port e7cdecb7-cc49-44df-88cb-f73a38f9c157. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG nova.network.neutron [req-d11ff8a0-67de-44a7-b5f0-46ae85e7f138 req-055873ce-4aaf-4e9c-a1ed-7cfc16d23aed service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Updating instance_info_cache with network_info: [{"id": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "address": "fa:16:3e:9c:eb:bf", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7cdecb7-cc", "ovs_interfaceid": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:23:32 user nova-compute[75993]: INFO nova.compute.manager [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Terminating instance
Nov 08 22:23:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d11ff8a0-67de-44a7-b5f0-46ae85e7f138 req-055873ce-4aaf-4e9c-a1ed-7cfc16d23aed service nova] Releasing lock "refresh_cache-c416012d-2a15-4c77-a959-6e51d72fc94e" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-a26e9ef7-a98b-4b84-986e-df766a2ac2d8 req-81cc8389-de82-49b8-9dcf-fdc5aeb66cf1 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-vif-unplugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a26e9ef7-a98b-4b84-986e-df766a2ac2d8 req-81cc8389-de82-49b8-9dcf-fdc5aeb66cf1 service nova] Acquiring lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a26e9ef7-a98b-4b84-986e-df766a2ac2d8 req-81cc8389-de82-49b8-9dcf-fdc5aeb66cf1 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-a26e9ef7-a98b-4b84-986e-df766a2ac2d8 req-81cc8389-de82-49b8-9dcf-fdc5aeb66cf1 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-a26e9ef7-a98b-4b84-986e-df766a2ac2d8 req-81cc8389-de82-49b8-9dcf-fdc5aeb66cf1 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] No waiting events found dispatching network-vif-unplugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-a26e9ef7-a98b-4b84-986e-df766a2ac2d8 req-81cc8389-de82-49b8-9dcf-fdc5aeb66cf1 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-vif-unplugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Instance destroyed successfully.
Nov 08 22:23:33 user nova-compute[75993]: DEBUG nova.objects.instance [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'resources' on Instance uuid c416012d-2a15-4c77-a959-6e51d72fc94e {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:21:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-288770879',display_name='tempest-AttachVolumeNegativeTest-server-288770879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-288770879',id=45,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD6ZXsxPT9Ib1a6sFMHdFBgu4Sq7wexWN5KowY6pxdJl8YbVkjOruzJLM42Z9jAJx8zpqxMDt5qibKyiP8FRR410tVa4qvVjwCex/15bwX8gwxBkZTNFCLJf8lE/6xq5rQ==',key_name='tempest-keypair-2041106199',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-by0545pi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:21:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=c416012d-2a15-4c77-a959-6e51d72fc94e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "address": "fa:16:3e:9c:eb:bf", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7cdecb7-cc", "ovs_interfaceid": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "address": "fa:16:3e:9c:eb:bf", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7cdecb7-cc", "ovs_interfaceid": "e7cdecb7-cc49-44df-88cb-f73a38f9c157", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:eb:bf,bridge_name='br-int',has_traffic_filtering=True,id=e7cdecb7-cc49-44df-88cb-f73a38f9c157,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7cdecb7-cc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG os_vif [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:eb:bf,bridge_name='br-int',has_traffic_filtering=True,id=e7cdecb7-cc49-44df-88cb-f73a38f9c157,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7cdecb7-cc') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7cdecb7-cc, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d7c3fc61-1912-4f98-83ca-b5668cdd3342) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:23:33 user nova-compute[75993]: INFO os_vif [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:eb:bf,bridge_name='br-int',has_traffic_filtering=True,id=e7cdecb7-cc49-44df-88cb-f73a38f9c157,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7cdecb7-cc')
Nov 08 22:23:33 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Deleting instance files /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e_del
Nov 08 22:23:33 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Deletion of /opt/stack/data/nova/instances/c416012d-2a15-4c77-a959-6e51d72fc94e_del complete
Nov 08 22:23:33 user nova-compute[75993]: INFO nova.compute.manager [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 08 22:23:33 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:34 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:23:34 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Took 1.03 seconds to deallocate network for instance.
Nov 08 22:23:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:34 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:23:34 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:23:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:34 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Deleted allocations for instance c416012d-2a15-4c77-a959-6e51d72fc94e
Nov 08 22:23:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-30fe6316-5064-420d-89e7-29e14c0111b9 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.015s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Acquiring lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] No waiting events found dispatching network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:23:35 user nova-compute[75993]: WARNING nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received unexpected event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 for instance with vm_state deleted and task_state None.
Nov 08 22:23:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Acquiring lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] No waiting events found dispatching network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:23:35 user nova-compute[75993]: WARNING nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received unexpected event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 for instance with vm_state deleted and task_state None.
Nov 08 22:23:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Acquiring lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] No waiting events found dispatching network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:23:35 user nova-compute[75993]: WARNING nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received unexpected event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 for instance with vm_state deleted and task_state None.
Nov 08 22:23:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-vif-unplugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Acquiring lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] No waiting events found dispatching network-vif-unplugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:23:35 user nova-compute[75993]: WARNING nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received unexpected event network-vif-unplugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 for instance with vm_state deleted and task_state None.
Nov 08 22:23:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Acquiring lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] Lock "c416012d-2a15-4c77-a959-6e51d72fc94e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] No waiting events found dispatching network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:23:35 user nova-compute[75993]: WARNING nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received unexpected event network-vif-plugged-e7cdecb7-cc49-44df-88cb-f73a38f9c157 for instance with vm_state deleted and task_state None.
Nov 08 22:23:35 user nova-compute[75993]: DEBUG nova.compute.manager [req-accb33ce-d080-4a5b-b798-ef733f238b73 req-5b63effa-db81-4672-a59a-739f6d203816 service nova] [instance: c416012d-2a15-4c77-a959-6e51d72fc94e] Received event network-vif-deleted-e7cdecb7-cc49-44df-88cb-f73a38f9c157 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:23:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:23:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:37 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:23:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:37 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:23:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:37 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:23:38 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:23:38 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:23:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=24.962566375732422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7486651d-b863-403c-9118-c366a4e3e9e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0673e053-a814-4a5e-bf67-d31f07b0c194 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance dfe019af-f761-4edd-8099-5b635d5e9eb2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:23:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:40 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:23:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:23:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-54c081a7-b3a2-4a04-9b18-e36c84b93b7d req-2f47492d-0485-4749-b9e5-0b1729665b3e service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Received event network-changed-22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:43 user nova-compute[75993]: DEBUG nova.compute.manager [req-54c081a7-b3a2-4a04-9b18-e36c84b93b7d req-2f47492d-0485-4749-b9e5-0b1729665b3e service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Refreshing instance network info cache due to event network-changed-22cf273c-572a-4f24-9464-266c3cfd19cd. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:23:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54c081a7-b3a2-4a04-9b18-e36c84b93b7d req-2f47492d-0485-4749-b9e5-0b1729665b3e service nova] Acquiring lock "refresh_cache-dfe019af-f761-4edd-8099-5b635d5e9eb2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:23:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54c081a7-b3a2-4a04-9b18-e36c84b93b7d req-2f47492d-0485-4749-b9e5-0b1729665b3e service nova] Acquired lock "refresh_cache-dfe019af-f761-4edd-8099-5b635d5e9eb2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:23:43 user nova-compute[75993]: DEBUG nova.network.neutron [req-54c081a7-b3a2-4a04-9b18-e36c84b93b7d req-2f47492d-0485-4749-b9e5-0b1729665b3e service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Refreshing network info cache for port 22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-54c081a7-b3a2-4a04-9b18-e36c84b93b7d req-2f47492d-0485-4749-b9e5-0b1729665b3e service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Updated VIF entry in instance network info cache for port 22cf273c-572a-4f24-9464-266c3cfd19cd. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-54c081a7-b3a2-4a04-9b18-e36c84b93b7d req-2f47492d-0485-4749-b9e5-0b1729665b3e service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Updating instance_info_cache with network_info: [{"id": "22cf273c-572a-4f24-9464-266c3cfd19cd", "address": "fa:16:3e:a1:d2:15", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cf273c-57", "ovs_interfaceid": "22cf273c-572a-4f24-9464-266c3cfd19cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-54c081a7-b3a2-4a04-9b18-e36c84b93b7d req-2f47492d-0485-4749-b9e5-0b1729665b3e service nova] Releasing lock "refresh_cache-dfe019af-f761-4edd-8099-5b635d5e9eb2" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "dfe019af-f761-4edd-8099-5b635d5e9eb2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:44 user nova-compute[75993]: INFO nova.compute.manager [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Terminating instance
Nov 08 22:23:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:45 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Instance destroyed successfully.
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.objects.instance [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'resources' on Instance uuid dfe019af-f761-4edd-8099-5b635d5e9eb2 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:21:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-509623729',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-509623729',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-509623729',id=46,image_ref='5e784ecf-6f1f-431f-acc6-f1ecb00ab34a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw4RW2+vHlCFh5+f4BT9uYba+rjlbGAuEabbwSLH8bHoxOXaEAZTnfkY8Px25T29Csl0jNKq6uQCIhO7yD5YssPmKCdpxpL2FFCq5UTGK7OTy8VNvNpDbegNgim83n5yg==',key_name='tempest-keypair-1620080344',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:22:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-lxbqyxud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1717039666',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:22:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=dfe019af-f761-4edd-8099-5b635d5e9eb2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22cf273c-572a-4f24-9464-266c3cfd19cd", "address": "fa:16:3e:a1:d2:15", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cf273c-57", "ovs_interfaceid": "22cf273c-572a-4f24-9464-266c3cfd19cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "22cf273c-572a-4f24-9464-266c3cfd19cd", "address": "fa:16:3e:a1:d2:15", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22cf273c-57", "ovs_interfaceid": "22cf273c-572a-4f24-9464-266c3cfd19cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=22cf273c-572a-4f24-9464-266c3cfd19cd,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cf273c-57') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_vif [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=22cf273c-572a-4f24-9464-266c3cfd19cd,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cf273c-57') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22cf273c-57, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18b40842-76d1-4c1d-aafb-5664fb8b0409) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:23:45 user nova-compute[75993]: INFO os_vif [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:d2:15,bridge_name='br-int',has_traffic_filtering=True,id=22cf273c-572a-4f24-9464-266c3cfd19cd,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22cf273c-57')
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMtBwFuR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:23:45 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dce1a60-3ce7-421b-83b3-92c3a3419da2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:23:45 user nova-compute[75993]: No targets found.
Nov 08 22:23:45 user nova-compute[75993]: iSNS:
Nov 08 22:23:45 user nova-compute[75993]: No targets found.
Nov 08 22:23:45 user nova-compute[75993]: STATIC:
Nov 08 22:23:45 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647
Nov 08 22:23:45 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:23:45 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:23:45 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d
Nov 08 22:23:45 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:23:45 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:23:45 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c
Nov 08 22:23:45 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:23:45 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:23:45 user nova-compute[75993]: FIRMWARE:
Nov 08 22:23:45 user nova-compute[75993]: No targets found.
Nov 08 22:23:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:23:45 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:23:45 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28104eb-7f1b-4fa0-b3cd-637c4b3d3fa8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e24c526-366f-4a07-aaa4-ef6893d2b01b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:23:45 user nova-compute[75993]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)
Nov 08 22:23:45 user nova-compute[75993]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c (non-flash)
Nov 08 22:23:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:23:45 user nova-compute[75993]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)
Nov 08 22:23:45 user nova-compute[75993]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c (non-flash)
Nov 08 22:23:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544b1e710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c'): ({'sdd'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Removing single pathed devices sdd {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ebaa0c-7e14-4969-bd61-6280d231d78d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f876e4f9-0ce8-4b6a-a202-d230542b9566]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flushing IO for device /dev/sdd {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[106343b5-fd30-45aa-aa8f-704ef17e183c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.028s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0439e67-25ce-4247-ae61-4f04e3fd802c]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] SCSI volumes sdd have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c105e4-ecf9-4ae5-b53e-7630e7b50175]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c936f88b-3f4d-44ac-a83b-679314959a63]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c, portal: 172.16.0.220,3260]
Nov 08 22:23:45 user nova-compute[75993]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c, portal: 172.16.0.220,3260] successful.
Nov 08 22:23:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c42442f-22f8-4a5b-8fdb-77af4510321c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e9994f-7fb6-497a-ba4d-57c132cfedcb]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== disconnect_volume: return (291ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:23:45 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Deleting instance files /opt/stack/data/nova/instances/dfe019af-f761-4edd-8099-5b635d5e9eb2_del
Nov 08 22:23:45 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Deletion of /opt/stack/data/nova/instances/dfe019af-f761-4edd-8099-5b635d5e9eb2_del complete
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:23:45 user nova-compute[75993]: INFO nova.compute.manager [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Received event network-vif-unplugged-22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] Acquiring lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] No waiting events found dispatching network-vif-unplugged-22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Received event network-vif-unplugged-22cf273c-572a-4f24-9464-266c3cfd19cd for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Received event network-vif-plugged-22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] Acquiring lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] No waiting events found dispatching network-vif-plugged-22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:23:45 user nova-compute[75993]: WARNING nova.compute.manager [req-fd07e38c-70db-4c47-a952-83a8d7d1f193 req-40ef35b4-37f7-4031-a5a3-19be6a6478d1 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Received unexpected event network-vif-plugged-22cf273c-572a-4f24-9464-266c3cfd19cd for instance with vm_state active and task_state deleting.
Nov 08 22:23:46 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:23:46 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Took 0.81 seconds to deallocate network for instance.
Nov 08 22:23:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-d2e00771-dfba-4f5b-9c7f-5105afc309e1 req-637463f8-f64b-4027-91bf-88cc2748f0d9 service nova] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Received event network-vif-deleted-22cf273c-572a-4f24-9464-266c3cfd19cd {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:23:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:47 user nova-compute[75993]: INFO nova.compute.manager [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Took 0.93 seconds to detach 1 volumes for instance.
Nov 08 22:23:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: dfe019af-f761-4edd-8099-5b635d5e9eb2] Deleting volume: 2c42442f-22f8-4a5b-8fdb-77af4510321c {{(pid=75993) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 22:23:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:23:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:23:47 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:23:47 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:23:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:47 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Deleted allocations for instance dfe019af-f761-4edd-8099-5b635d5e9eb2
Nov 08 22:23:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8edcc79d-c08d-4a2a-abe5-b62ae429ade1 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "dfe019af-f761-4edd-8099-5b635d5e9eb2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.306s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:23:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:23:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:24:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:24:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:24:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:24:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:24:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:24:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:24:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:24:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:24:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:24:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:24 user nova-compute[75993]: INFO nova.compute.manager [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Detaching volume dfc4a7b7-065d-4969-9200-1400fc435647
Nov 08 22:24:24 user nova-compute[75993]: INFO nova.virt.block_device [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Attempting to driver detach volume dfc4a7b7-065d-4969-9200-1400fc435647 from mountpoint /dev/vdb
Nov 08 22:24:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Attempting to detach device vdb from instance 7486651d-b863-403c-9118-c366a4e3e9e0 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 22:24:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:24:24 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:24:24 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 22:24:24 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:24:24 user nova-compute[75993]:   <serial>dfc4a7b7-065d-4969-9200-1400fc435647</serial>
Nov 08 22:24:24 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:24:24 user nova-compute[75993]: </disk>
Nov 08 22:24:24 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:24:24 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully detached device vdb from instance 7486651d-b863-403c-9118-c366a4e3e9e0 from the persistent domain config.
Nov 08 22:24:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7486651d-b863-403c-9118-c366a4e3e9e0 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 22:24:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:24:24 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:24:24 user nova-compute[75993]:   <source dev="/dev/sdc"/>
Nov 08 22:24:24 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:24:24 user nova-compute[75993]:   <serial>dfc4a7b7-065d-4969-9200-1400fc435647</serial>
Nov 08 22:24:24 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:24:24 user nova-compute[75993]: </disk>
Nov 08 22:24:24 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:24:24 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7486651d-b863-403c-9118-c366a4e3e9e0 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 22:24:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:27 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:24:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:24:32 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:24:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:24:32 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:24:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:24:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:24:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:24:37 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:24:37 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:24:37 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:24:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:37 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:24:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:37 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:24:38 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:24:38 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:24:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8823MB free_disk=24.953746795654297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 7486651d-b863-403c-9118-c366a4e3e9e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 0673e053-a814-4a5e-bf67-d31f07b0c194 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:24:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:24:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:24:44 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7486651d-b863-403c-9118-c366a4e3e9e0 is timed out.
Nov 08 22:24:44 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully detached device vdb from instance 7486651d-b863-403c-9118-c366a4e3e9e0 from the live domain config.
Nov 08 22:24:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LsxjYGIv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:24:44 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a077e22-2c0c-495e-b11c-a40721bcdc97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:24:44 user nova-compute[75993]: No targets found.
Nov 08 22:24:44 user nova-compute[75993]: iSNS:
Nov 08 22:24:44 user nova-compute[75993]: No targets found.
Nov 08 22:24:44 user nova-compute[75993]: STATIC:
Nov 08 22:24:44 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647
Nov 08 22:24:44 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:24:44 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:24:44 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d
Nov 08 22:24:44 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:24:44 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:24:44 user nova-compute[75993]: FIRMWARE:
Nov 08 22:24:44 user nova-compute[75993]: No targets found.
Nov 08 22:24:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:24:44 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:24:44 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b3f8aa-0425-413f-a3d3-d37db7bb7bfd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[903c2d9e-e7d7-44de-adad-01fa866ec01d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:24:44 user nova-compute[75993]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)
Nov 08 22:24:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:24:44 user nova-compute[75993]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 (non-flash)
Nov 08 22:24:44 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544ea5120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fecaa73-11fb-4c78-af0e-8fa81f8f5234]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e32d1-2011-4bc2-b463-5a89d875eba8]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[522a84c0-47cd-43c0-a37a-f35ad61366db]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aa153b-3567-4226-be80-319c0b50a4d3]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e730d6-5c94-4863-88df-2b8dbb8a2d8c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:24:44 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aa5568-0661-4e88-8c6d-f57132ed144b]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647, portal: 172.16.0.220,3260]
Nov 08 22:24:45 user nova-compute[75993]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647, portal: 172.16.0.220,3260] successful.
Nov 08 22:24:45 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dfc4a7b7-065d-4969-9200-1400fc435647 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[484653fc-2022-493d-a413-286b28dcb4a9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] <== disconnect_volume: return (302ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:24:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'flavor' on Instance uuid 7486651d-b863-403c-9118-c366a4e3e9e0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:24:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-8b5a3e6f-93c6-4eeb-8602-377c9bd070e3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.823s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:46 user nova-compute[75993]: INFO nova.compute.manager [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Terminating instance
Nov 08 22:24:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:24:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-3e824974-62a3-4b02-9019-1bbb2aa9bda3 req-699a5ce8-34ff-49d3-86b7-060873c04571 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-vif-unplugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e824974-62a3-4b02-9019-1bbb2aa9bda3 req-699a5ce8-34ff-49d3-86b7-060873c04571 service nova] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e824974-62a3-4b02-9019-1bbb2aa9bda3 req-699a5ce8-34ff-49d3-86b7-060873c04571 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3e824974-62a3-4b02-9019-1bbb2aa9bda3 req-699a5ce8-34ff-49d3-86b7-060873c04571 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-3e824974-62a3-4b02-9019-1bbb2aa9bda3 req-699a5ce8-34ff-49d3-86b7-060873c04571 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] No waiting events found dispatching network-vif-unplugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-3e824974-62a3-4b02-9019-1bbb2aa9bda3 req-699a5ce8-34ff-49d3-86b7-060873c04571 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-vif-unplugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Instance destroyed successfully.
Nov 08 22:24:47 user nova-compute[75993]: DEBUG nova.objects.instance [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'resources' on Instance uuid 0673e053-a814-4a5e-bf67-d31f07b0c194 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1065517061',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1065517061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1065517061',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKll+7UmEWvkcTqIUYq60MWgpkVhK5xUTclcdrt9+QUOna6phFQ72FCVbrhoXRTnsDPnpWfVeFsYunw9J1iXtWUWdYKI8O51144UipUFnrLayJVOjWzbXEUoTxh9j7Gmcw==',key_name='tempest-keypair-1719145441',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:20:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-jmvua2mu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:20:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=0673e053-a814-4a5e-bf67-d31f07b0c194,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "address": "fa:16:3e:51:b7:a8", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.77", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap436c711e-5c", "ovs_interfaceid": "436c711e-5c99-49b7-8df9-a1e1d5924b10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=436c711e-5c99-49b7-8df9-a1e1d5924b10,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c711e-5c') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_vif [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=436c711e-5c99-49b7-8df9-a1e1d5924b10,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c711e-5c') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap436c711e-5c, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8243490-c8fa-4f10-9a26-4477072eda1c) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:24:47 user nova-compute[75993]: INFO os_vif [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:b7:a8,bridge_name='br-int',has_traffic_filtering=True,id=436c711e-5c99-49b7-8df9-a1e1d5924b10,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap436c711e-5c')
Nov 08 22:24:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TBybcPgJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:24:47 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ea1fee-8db1-42b5-a76b-cfc5b5c70114]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:24:47 user nova-compute[75993]: No targets found.
Nov 08 22:24:47 user nova-compute[75993]: iSNS:
Nov 08 22:24:47 user nova-compute[75993]: No targets found.
Nov 08 22:24:47 user nova-compute[75993]: STATIC:
Nov 08 22:24:47 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d
Nov 08 22:24:47 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:24:47 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:24:47 user nova-compute[75993]: FIRMWARE:
Nov 08 22:24:47 user nova-compute[75993]: No targets found.
Nov 08 22:24:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:24:47 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:24:47 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84475e0-72a2-4044-8328-7d88576cbdac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[638f6314-b3f6-4552-949c-dd1811219ff8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:24:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d (non-flash)
Nov 08 22:24:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544ea7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b3fbf7-85a8-445f-8cfa-6078e7128882]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f94ea7-f2a6-46c2-83d4-67653e396294]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[166cbf00-8d44-488c-98bd-1c54ac643a9f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e039703-961d-4b15-910e-4360d12a3747]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9a0395e7-fba6a43d2c8b548c', '/dev/disk/by-id/scsi-26662613661343364', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9a0395e7') {{(pid=86999) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b81cc4-e471-4323-98f1-c00912463335]: (4, None) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f2fa0c-5d70-4906-b82e-156a340d4bf2]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdaaf40-5558-4b21-8888-b0a29cc2b7bb]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d, portal: 172.16.0.220,3260]
Nov 08 22:24:47 user nova-compute[75993]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d, portal: 172.16.0.220,3260] successful.
Nov 08 22:24:47 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43e75452-5211-4d7e-a96f-a83b7c76953d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1589f52f-967f-4a5f-9fad-486ac5cc0bc1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== disconnect_volume: return (352ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:24:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Deleting instance files /opt/stack/data/nova/instances/0673e053-a814-4a5e-bf67-d31f07b0c194_del
Nov 08 22:24:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Deletion of /opt/stack/data/nova/instances/0673e053-a814-4a5e-bf67-d31f07b0c194_del complete
Nov 08 22:24:47 user nova-compute[75993]: INFO nova.compute.manager [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 08 22:24:47 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:48 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:24:48 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Took 1.19 seconds to deallocate network for instance.
Nov 08 22:24:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-29e2aea2-5b07-4795-98ed-822e8032e4e1 req-8d1bafec-ebd0-4da2-b851-4263f8e65795 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-vif-deleted-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] No waiting events found dispatching network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:24:49 user nova-compute[75993]: WARNING nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received unexpected event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 for instance with vm_state active and task_state deleting.
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] No waiting events found dispatching network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:24:49 user nova-compute[75993]: WARNING nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received unexpected event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 for instance with vm_state active and task_state deleting.
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] No waiting events found dispatching network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:24:49 user nova-compute[75993]: WARNING nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received unexpected event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 for instance with vm_state active and task_state deleting.
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-vif-unplugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] No waiting events found dispatching network-vif-unplugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-vif-unplugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Acquiring lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] No waiting events found dispatching network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:24:49 user nova-compute[75993]: WARNING nova.compute.manager [req-d1c526f5-f555-4158-84f5-f873c54bb5a0 req-3b576bfc-b858-429c-839b-ebe727b7eb19 service nova] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Received unexpected event network-vif-plugged-436c711e-5c99-49b7-8df9-a1e1d5924b10 for instance with vm_state active and task_state deleting.
Nov 08 22:24:49 user nova-compute[75993]: INFO nova.compute.manager [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Took 0.89 seconds to detach 1 volumes for instance.
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 0673e053-a814-4a5e-bf67-d31f07b0c194] Deleting volume: 43e75452-5211-4d7e-a96f-a83b7c76953d {{(pid=75993) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:24:49 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:24:50 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:24:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:50 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Deleted allocations for instance 0673e053-a814-4a5e-bf67-d31f07b0c194
Nov 08 22:24:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-fa35a4f3-40b0-4d2a-9f14-3a5d9094ed25 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "0673e053-a814-4a5e-bf67-d31f07b0c194" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.680s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:24:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:24:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:24:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:14 user nova-compute[75993]: INFO nova.compute.manager [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Terminating instance
Nov 08 22:25:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-c3f251e9-0aaa-4cc6-815e-d67ed61a4cf3 req-eed278af-9fdc-4ac6-a7e1-ad184a225ba4 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-vif-unplugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c3f251e9-0aaa-4cc6-815e-d67ed61a4cf3 req-eed278af-9fdc-4ac6-a7e1-ad184a225ba4 service nova] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c3f251e9-0aaa-4cc6-815e-d67ed61a4cf3 req-eed278af-9fdc-4ac6-a7e1-ad184a225ba4 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c3f251e9-0aaa-4cc6-815e-d67ed61a4cf3 req-eed278af-9fdc-4ac6-a7e1-ad184a225ba4 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-c3f251e9-0aaa-4cc6-815e-d67ed61a4cf3 req-eed278af-9fdc-4ac6-a7e1-ad184a225ba4 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] No waiting events found dispatching network-vif-unplugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:25:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-c3f251e9-0aaa-4cc6-815e-d67ed61a4cf3 req-eed278af-9fdc-4ac6-a7e1-ad184a225ba4 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-vif-unplugged-19d4d016-2f33-4fe5-a283-93994869bc57 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Instance destroyed successfully.
Nov 08 22:25:15 user nova-compute[75993]: DEBUG nova.objects.instance [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'resources' on Instance uuid 7486651d-b863-403c-9118-c366a4e3e9e0 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:19:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-513394518',display_name='tempest-AttachVolumeNegativeTest-server-513394518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-513394518',id=43,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQFCy7kQbPW8FvdgA92SeOHlnYL/VEUdIVT2RulHmsHjOtVVGmF/58VD42WTfvlPcv4/zzFGVVT4rGLybBJpXFVALJkJogb/UDOxmaFMArmjaJv9ZbWJPpDwq4gYZ/ORQ==',key_name='tempest-keypair-1006936627',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:19:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-0dk0ay31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:19:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=7486651d-b863-403c-9118-c366a4e3e9e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "19d4d016-2f33-4fe5-a283-93994869bc57", "address": "fa:16:3e:ea:e9:d8", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19d4d016-2f", "ovs_interfaceid": "19d4d016-2f33-4fe5-a283-93994869bc57", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=19d4d016-2f33-4fe5-a283-93994869bc57,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d4d016-2f') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG os_vif [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=19d4d016-2f33-4fe5-a283-93994869bc57,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d4d016-2f') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19d4d016-2f, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1fbbdb27-3a9e-4d48-bdc5-4ee4e15e9262) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:15 user nova-compute[75993]: INFO os_vif [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e9:d8,bridge_name='br-int',has_traffic_filtering=True,id=19d4d016-2f33-4fe5-a283-93994869bc57,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19d4d016-2f')
Nov 08 22:25:15 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Deleting instance files /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0_del
Nov 08 22:25:15 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Deletion of /opt/stack/data/nova/instances/7486651d-b863-403c-9118-c366a4e3e9e0_del complete
Nov 08 22:25:15 user nova-compute[75993]: INFO nova.compute.manager [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 08 22:25:15 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:25:16 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Took 1.12 seconds to deallocate network for instance.
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:16 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Deleted allocations for instance 7486651d-b863-403c-9118-c366a4e3e9e0
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-2854ab5a-11d7-4c69-9ba4-7116ef7e3b4f tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "7486651d-b863-403c-9118-c366a4e3e9e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.268s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] No waiting events found dispatching network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:25:16 user nova-compute[75993]: WARNING nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received unexpected event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 for instance with vm_state deleted and task_state None.
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] No waiting events found dispatching network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:25:16 user nova-compute[75993]: WARNING nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received unexpected event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 for instance with vm_state deleted and task_state None.
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] No waiting events found dispatching network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:25:16 user nova-compute[75993]: WARNING nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received unexpected event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 for instance with vm_state deleted and task_state None.
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-vif-unplugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] No waiting events found dispatching network-vif-unplugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:25:16 user nova-compute[75993]: WARNING nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received unexpected event network-vif-unplugged-19d4d016-2f33-4fe5-a283-93994869bc57 for instance with vm_state deleted and task_state None.
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Acquiring lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] Lock "7486651d-b863-403c-9118-c366a4e3e9e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] No waiting events found dispatching network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:25:16 user nova-compute[75993]: WARNING nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received unexpected event network-vif-plugged-19d4d016-2f33-4fe5-a283-93994869bc57 for instance with vm_state deleted and task_state None.
Nov 08 22:25:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-280c74a0-0bcd-48ef-af99-fc6e0a730734 req-bbfef49c-4543-4903-9047-3ae61fad8d20 service nova] [instance: 7486651d-b863-403c-9118-c366a4e3e9e0] Received event network-vif-deleted-19d4d016-2f33-4fe5-a283-93994869bc57 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:25:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:25:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:25 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:29 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:25:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:30 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:33 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:25:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:25:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:25:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:25:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:35 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:36 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:37 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:37 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:38 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:38 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:25:38 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:25:38 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:25:38 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=24.980327606201172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:25:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:39 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:25:39 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:25:39 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 22:25:39 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 22:25:39 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 22:25:39 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 22:25:39 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 22:25:39 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:25:39 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:25:39 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:25:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:25:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 22:25:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:25:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:25:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:53 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:25:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 22:25:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 22:25:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:25:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:25:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:25:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:25:58 user nova-compute[75993]: INFO nova.compute.claims [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Claim successful on node user
Nov 08 22:25:58 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.189s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:25:58 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:25:58 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:25:58 user nova-compute[75993]: INFO nova.virt.block_device [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Booting with volume a4852d97-3bb7-47bb-8e1e-e96bb215c036 at /dev/vda
Nov 08 22:25:58 user nova-compute[75993]: DEBUG nova.policy [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4d2f038c60247b894c8849ee3b9183b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef08c827c91436bb907130af0c4f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG os_brick.utils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e60d53-1f64-4451-98ef-f92e19d6d7d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef3a39d-fe71-4cb9-b873-01a944a085ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eff2694-b196-4c27-a69c-884c853b6ea6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5768a53-773a-4163-b347-f688c153131f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:25:58 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:25:58 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afe495c-a4eb-469c-bb8b-8375ccc51b6b]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG os_brick.utils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:25:58 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Updating existing volume attachment record: a61751e1-f78f-428c-a13e-406fc7e85a88 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:25:59 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Successfully created port: f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:25:59 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Successfully updated port: f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquired lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-ecc421ec-f47b-431e-9a47-b9b46a373135 req-bdab15cd-76f5-4de9-843a-bbcb760e308c service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Received event network-changed-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-ecc421ec-f47b-431e-9a47-b9b46a373135 req-bdab15cd-76f5-4de9-843a-bbcb760e308c service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Refreshing instance network info cache due to event network-changed-f98843f7-9b57-4fde-9e2e-a029f9d0ef24. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ecc421ec-f47b-431e-9a47-b9b46a373135 req-bdab15cd-76f5-4de9-843a-bbcb760e308c service nova] Acquiring lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG nova.network.neutron [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Updating instance_info_cache with network_info: [{"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Releasing lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Instance network_info: |[{"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ecc421ec-f47b-431e-9a47-b9b46a373135 req-bdab15cd-76f5-4de9-843a-bbcb760e308c service nova] Acquired lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG nova.network.neutron [req-ecc421ec-f47b-431e-9a47-b9b46a373135 req-bdab15cd-76f5-4de9-843a-bbcb760e308c service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Refreshing network info cache for port f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG nova.network.neutron [req-ecc421ec-f47b-431e-9a47-b9b46a373135 req-bdab15cd-76f5-4de9-843a-bbcb760e308c service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Updated VIF entry in instance network info cache for port f98843f7-9b57-4fde-9e2e-a029f9d0ef24. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG nova.network.neutron [req-ecc421ec-f47b-431e-9a47-b9b46a373135 req-bdab15cd-76f5-4de9-843a-bbcb760e308c service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Updating instance_info_cache with network_info: [{"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:26:00 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ecc421ec-f47b-431e-9a47-b9b46a373135 req-bdab15cd-76f5-4de9-843a-bbcb760e308c service nova] Releasing lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:26:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:07 user nova-compute[75993]: DEBUG nova.compute.manager [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:26:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:07 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:26:07 user nova-compute[75993]: INFO nova.compute.claims [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Claim successful on node user
Nov 08 22:26:08 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.202s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG nova.network.neutron [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:26:08 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:26:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG nova.policy [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be86d9fb78614dbeaaf9faa42bbf2868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8260793f85b4fa7a83c779f7f6c58e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG nova.compute.manager [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:26:08 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Creating image(s)
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "/opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "/opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "/opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.204s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.190s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk 1073741824" returned: 0 in 0.064s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:08 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Successfully created port: 642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.191s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Cannot resize image /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Ensure instance console log exists: /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Successfully updated port: 642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquired lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-3550a17d-bbd3-443e-8aab-5500bd31d2c0 req-2b6c2c84-5bc0-465d-af7a-2cb8bd998622 service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Received event network-changed-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG nova.compute.manager [req-3550a17d-bbd3-443e-8aab-5500bd31d2c0 req-2b6c2c84-5bc0-465d-af7a-2cb8bd998622 service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Refreshing instance network info cache due to event network-changed-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3550a17d-bbd3-443e-8aab-5500bd31d2c0 req-2b6c2c84-5bc0-465d-af7a-2cb8bd998622 service nova] Acquiring lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:26:09 user nova-compute[75993]: DEBUG nova.network.neutron [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.network.neutron [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Updating instance_info_cache with network_info: [{"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Releasing lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Instance network_info: |[{"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3550a17d-bbd3-443e-8aab-5500bd31d2c0 req-2b6c2c84-5bc0-465d-af7a-2cb8bd998622 service nova] Acquired lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.network.neutron [req-3550a17d-bbd3-443e-8aab-5500bd31d2c0 req-2b6c2c84-5bc0-465d-af7a-2cb8bd998622 service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Refreshing network info cache for port 642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Start _get_guest_xml network_info=[{"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:26:10 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:26:10 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1334016749',display_name='tempest-AttachVolumeNegativeTest-server-1334016749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1334016749',id=48,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLqSbOnGzuGbUKGjiU1cJrtrhDXzET4VMs80Fe1LOtEAUCAbXsSUpPhsSQ5vdKURml5NiLu/ql9RxYW5i15SX3Bf+X2fl946nOCgj9sZnHUY3iaLDgDPbELEOhc8z+xKg==',key_name='tempest-keypair-1139077265',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-vhzdz72g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=eadd1e8f-5e46-4469-894e-21d24933a5c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:6a:85,bridge_name='br-int',has_traffic_filtering=True,id=642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642ee8eb-5d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.objects.instance [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'pci_devices' on Instance uuid eadd1e8f-5e46-4469-894e-21d24933a5c1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:26:10 user nova-compute[75993]:   <uuid>eadd1e8f-5e46-4469-894e-21d24933a5c1</uuid>
Nov 08 22:26:10 user nova-compute[75993]:   <name>instance-00000030</name>
Nov 08 22:26:10 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:26:10 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:26:10 user nova-compute[75993]:   <metadata>
Nov 08 22:26:10 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:26:10 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:26:10 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1334016749</nova:name>
Nov 08 22:26:10 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:26:10</nova:creationTime>
Nov 08 22:26:10 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:26:10 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:26:10 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:26:10 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:26:10 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:26:10 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:26:10 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:26:10 user nova-compute[75993]:       <nova:owner>
Nov 08 22:26:10 user nova-compute[75993]:         <nova:user uuid="be86d9fb78614dbeaaf9faa42bbf2868">tempest-AttachVolumeNegativeTest-1149565506-project-member</nova:user>
Nov 08 22:26:10 user nova-compute[75993]:         <nova:project uuid="b8260793f85b4fa7a83c779f7f6c58e3">tempest-AttachVolumeNegativeTest-1149565506</nova:project>
Nov 08 22:26:10 user nova-compute[75993]:       </nova:owner>
Nov 08 22:26:10 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 22:26:10 user nova-compute[75993]:       <nova:ports>
Nov 08 22:26:10 user nova-compute[75993]:         <nova:port uuid="642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28">
Nov 08 22:26:10 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 22:26:10 user nova-compute[75993]:         </nova:port>
Nov 08 22:26:10 user nova-compute[75993]:       </nova:ports>
Nov 08 22:26:10 user nova-compute[75993]:     </nova:instance>
Nov 08 22:26:10 user nova-compute[75993]:   </metadata>
Nov 08 22:26:10 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:26:10 user nova-compute[75993]:     <system>
Nov 08 22:26:10 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:26:10 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:26:10 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:26:10 user nova-compute[75993]:       <entry name="serial">eadd1e8f-5e46-4469-894e-21d24933a5c1</entry>
Nov 08 22:26:10 user nova-compute[75993]:       <entry name="uuid">eadd1e8f-5e46-4469-894e-21d24933a5c1</entry>
Nov 08 22:26:10 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:26:10 user nova-compute[75993]:     </system>
Nov 08 22:26:10 user nova-compute[75993]:   </sysinfo>
Nov 08 22:26:10 user nova-compute[75993]:   <os>
Nov 08 22:26:10 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:26:10 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:26:10 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:26:10 user nova-compute[75993]:   </os>
Nov 08 22:26:10 user nova-compute[75993]:   <features>
Nov 08 22:26:10 user nova-compute[75993]:     <acpi/>
Nov 08 22:26:10 user nova-compute[75993]:     <apic/>
Nov 08 22:26:10 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:26:10 user nova-compute[75993]:   </features>
Nov 08 22:26:10 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:26:10 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:26:10 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:26:10 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:26:10 user nova-compute[75993]:   </clock>
Nov 08 22:26:10 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:26:10 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:26:10 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:26:10 user nova-compute[75993]:   </cpu>
Nov 08 22:26:10 user nova-compute[75993]:   <devices>
Nov 08 22:26:10 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 22:26:10 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 22:26:10 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk"/>
Nov 08 22:26:10 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:26:10 user nova-compute[75993]:     </disk>
Nov 08 22:26:10 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:26:10 user nova-compute[75993]:       <mac address="fa:16:3e:d9:6a:85"/>
Nov 08 22:26:10 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:26:10 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:26:10 user nova-compute[75993]:       <target dev="tap642ee8eb-5d"/>
Nov 08 22:26:10 user nova-compute[75993]:     </interface>
Nov 08 22:26:10 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:26:10 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/console.log" append="off"/>
Nov 08 22:26:10 user nova-compute[75993]:     </serial>
Nov 08 22:26:10 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:26:10 user nova-compute[75993]:     <video>
Nov 08 22:26:10 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:26:10 user nova-compute[75993]:     </video>
Nov 08 22:26:10 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:26:10 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:26:10 user nova-compute[75993]:     </rng>
Nov 08 22:26:10 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:26:10 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:26:10 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:26:10 user nova-compute[75993]:     </memballoon>
Nov 08 22:26:10 user nova-compute[75993]:   </devices>
Nov 08 22:26:10 user nova-compute[75993]: </domain>
Nov 08 22:26:10 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1334016749',display_name='tempest-AttachVolumeNegativeTest-server-1334016749',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1334016749',id=48,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLqSbOnGzuGbUKGjiU1cJrtrhDXzET4VMs80Fe1LOtEAUCAbXsSUpPhsSQ5vdKURml5NiLu/ql9RxYW5i15SX3Bf+X2fl946nOCgj9sZnHUY3iaLDgDPbELEOhc8z+xKg==',key_name='tempest-keypair-1139077265',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-vhzdz72g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:26:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=eadd1e8f-5e46-4469-894e-21d24933a5c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:6a:85,bridge_name='br-int',has_traffic_filtering=True,id=642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642ee8eb-5d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG os_vif [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:6a:85,bridge_name='br-int',has_traffic_filtering=True,id=642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642ee8eb-5d') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55dd194b-e65a-5bae-892c-eccb2d94c85f', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap642ee8eb-5d, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap642ee8eb-5d, col_values=(('qos', UUID('4ce3212f-3975-47cf-8806-4536ff51d502')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap642ee8eb-5d, col_values=(('external_ids', {'iface-id': '642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:6a:85', 'vm-uuid': 'eadd1e8f-5e46-4469-894e-21d24933a5c1'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:10 user nova-compute[75993]: INFO os_vif [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:6a:85,bridge_name='br-int',has_traffic_filtering=True,id=642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642ee8eb-5d')
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No VIF found with MAC fa:16:3e:d9:6a:85, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.network.neutron [req-3550a17d-bbd3-443e-8aab-5500bd31d2c0 req-2b6c2c84-5bc0-465d-af7a-2cb8bd998622 service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Updated VIF entry in instance network info cache for port 642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG nova.network.neutron [req-3550a17d-bbd3-443e-8aab-5500bd31d2c0 req-2b6c2c84-5bc0-465d-af7a-2cb8bd998622 service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Updating instance_info_cache with network_info: [{"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:26:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3550a17d-bbd3-443e-8aab-5500bd31d2c0 req-2b6c2c84-5bc0-465d-af7a-2cb8bd998622 service nova] Releasing lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:26:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-526dc149-16af-4ada-9539-43f8f7d0fc22 req-79e878a5-ba7a-4630-b1d2-ab0559a0b10e service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Received event network-vif-plugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:26:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-526dc149-16af-4ada-9539-43f8f7d0fc22 req-79e878a5-ba7a-4630-b1d2-ab0559a0b10e service nova] Acquiring lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-526dc149-16af-4ada-9539-43f8f7d0fc22 req-79e878a5-ba7a-4630-b1d2-ab0559a0b10e service nova] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-526dc149-16af-4ada-9539-43f8f7d0fc22 req-79e878a5-ba7a-4630-b1d2-ab0559a0b10e service nova] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:11 user nova-compute[75993]: DEBUG nova.compute.manager [req-526dc149-16af-4ada-9539-43f8f7d0fc22 req-79e878a5-ba7a-4630-b1d2-ab0559a0b10e service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] No waiting events found dispatching network-vif-plugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:26:11 user nova-compute[75993]: WARNING nova.compute.manager [req-526dc149-16af-4ada-9539-43f8f7d0fc22 req-79e878a5-ba7a-4630-b1d2-ab0559a0b10e service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Received unexpected event network-vif-plugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 for instance with vm_state building and task_state spawning.
Nov 08 22:26:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:13 user nova-compute[75993]: DEBUG nova.compute.manager [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:26:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:26:13 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Instance spawned successfully.
Nov 08 22:26:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:26:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:13 user nova-compute[75993]: INFO nova.compute.manager [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 08 22:26:13 user nova-compute[75993]: DEBUG nova.compute.manager [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:26:14 user nova-compute[75993]: INFO nova.compute.manager [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Took 6.09 seconds to build instance.
Nov 08 22:26:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-2f3e8ab2-57c9-41a7-90fd-3d663decc3fa req-5ce46082-1b4d-4b43-86e7-673c4a89b38f service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Received event network-vif-plugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:26:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2f3e8ab2-57c9-41a7-90fd-3d663decc3fa req-5ce46082-1b4d-4b43-86e7-673c4a89b38f service nova] Acquiring lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2f3e8ab2-57c9-41a7-90fd-3d663decc3fa req-5ce46082-1b4d-4b43-86e7-673c4a89b38f service nova] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2f3e8ab2-57c9-41a7-90fd-3d663decc3fa req-5ce46082-1b4d-4b43-86e7-673c4a89b38f service nova] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-2f3e8ab2-57c9-41a7-90fd-3d663decc3fa req-5ce46082-1b4d-4b43-86e7-673c4a89b38f service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] No waiting events found dispatching network-vif-plugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:26:14 user nova-compute[75993]: WARNING nova.compute.manager [req-2f3e8ab2-57c9-41a7-90fd-3d663decc3fa req-5ce46082-1b4d-4b43-86e7-673c4a89b38f service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Received unexpected event network-vif-plugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 for instance with vm_state active and task_state None.
Nov 08 22:26:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-79c3eaba-79bc-4ae2-bcfe-0c55277d1a6e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.226s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:26:21 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Creating image(s)
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Ensure instance console log exists: /opt/stack/data/nova/instances/4f5a0081-40d0-4b65-aff7-cd8f8aa8e215/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Start _get_guest_xml network_info=[{"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'a61751e1-f78f-428c-a13e-406fc7e85a88', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhycXqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f5a0081-40d0-4b65-aff7-cd8f8aa8e215', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4852d97-3bb7-47bb-8e1e-e96bb215c036', 'serial': 'a4852d97-3bb7-47bb-8e1e-e96bb215c036'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:26:21 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:26:21 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhycXqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:26:21 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:26:21 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:26:21 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[89786af8-bc64-47e5-8db5-252069dc6a14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:26:21 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[794b1422-858d-4690-acb1-8266679c203f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036] added
Nov 08 22:26:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[58291b40-9f60-4960-b8df-77a95c6570ef]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea307d6-029b-457a-a2fb-11d807dfb2e1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDhycXqT {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDhycXqT" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc0f0f4-f487-4ccb-b73d-7fbb2b473197]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BDhycXqT'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbdd3d8-89c8-4e3d-af87-84e7e3732350]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3890b52-c47a-4a07-8f8b-61ffa25d82f4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:26:21 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:26:21 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:26:21 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 22:26:21 user nova-compute[75993]: 
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb95be6a-1f56-4a62-b8c1-c956ee34e210]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260]
Nov 08 22:26:21 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260] successful.
Nov 08 22:26:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7efedf-58a8-44d6-972c-2b06bc507996]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdd010b-5526-47ac-af9a-89415747173e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:26:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:26:21 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d41654a-2260-4b29-accc-af81ac976517]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:26:21 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhycXqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23366373639636263', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366373639636263', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1814404889',display_name='tempest-TestVolumeBootPattern-server-1814404889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1814404889',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtqgsG6SU0vF+HBwuY1w6anz7HT7ETGYSZ+dcW0ZWCVczHSpVsOGu3TwvVBpDTX6Z9hhqRptung3GUpoJgwg+8wpGEqUivf7YEwSNsT7kqzGjH87a2psJQ1CWH9W+Z7w==',key_name='tempest-TestVolumeBootPattern-662113852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-jbn4viao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:25:59Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=4f5a0081-40d0-4b65-aff7-cd8f8aa8e215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:9d:93,bridge_name='br-int',has_traffic_filtering=True,id=f98843f7-9b57-4fde-9e2e-a029f9d0ef24,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98843f7-9b') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG nova.objects.instance [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:26:22 user nova-compute[75993]:   <uuid>4f5a0081-40d0-4b65-aff7-cd8f8aa8e215</uuid>
Nov 08 22:26:22 user nova-compute[75993]:   <name>instance-0000002f</name>
Nov 08 22:26:22 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:26:22 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:26:22 user nova-compute[75993]:   <metadata>
Nov 08 22:26:22 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:26:22 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:26:22 user nova-compute[75993]:       <nova:name>tempest-TestVolumeBootPattern-server-1814404889</nova:name>
Nov 08 22:26:22 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:26:21</nova:creationTime>
Nov 08 22:26:22 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:26:22 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:26:22 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:26:22 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:26:22 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:26:22 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:26:22 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:26:22 user nova-compute[75993]:       <nova:owner>
Nov 08 22:26:22 user nova-compute[75993]:         <nova:user uuid="e4d2f038c60247b894c8849ee3b9183b">tempest-TestVolumeBootPattern-1717039666-project-member</nova:user>
Nov 08 22:26:22 user nova-compute[75993]:         <nova:project uuid="9ef08c827c91436bb907130af0c4f031">tempest-TestVolumeBootPattern-1717039666</nova:project>
Nov 08 22:26:22 user nova-compute[75993]:       </nova:owner>
Nov 08 22:26:22 user nova-compute[75993]:       <nova:ports>
Nov 08 22:26:22 user nova-compute[75993]:         <nova:port uuid="f98843f7-9b57-4fde-9e2e-a029f9d0ef24">
Nov 08 22:26:22 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 08 22:26:22 user nova-compute[75993]:         </nova:port>
Nov 08 22:26:22 user nova-compute[75993]:       </nova:ports>
Nov 08 22:26:22 user nova-compute[75993]:     </nova:instance>
Nov 08 22:26:22 user nova-compute[75993]:   </metadata>
Nov 08 22:26:22 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:26:22 user nova-compute[75993]:     <system>
Nov 08 22:26:22 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:26:22 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:26:22 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:26:22 user nova-compute[75993]:       <entry name="serial">4f5a0081-40d0-4b65-aff7-cd8f8aa8e215</entry>
Nov 08 22:26:22 user nova-compute[75993]:       <entry name="uuid">4f5a0081-40d0-4b65-aff7-cd8f8aa8e215</entry>
Nov 08 22:26:22 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:26:22 user nova-compute[75993]:     </system>
Nov 08 22:26:22 user nova-compute[75993]:   </sysinfo>
Nov 08 22:26:22 user nova-compute[75993]:   <os>
Nov 08 22:26:22 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:26:22 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:26:22 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:26:22 user nova-compute[75993]:   </os>
Nov 08 22:26:22 user nova-compute[75993]:   <features>
Nov 08 22:26:22 user nova-compute[75993]:     <acpi/>
Nov 08 22:26:22 user nova-compute[75993]:     <apic/>
Nov 08 22:26:22 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:26:22 user nova-compute[75993]:   </features>
Nov 08 22:26:22 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:26:22 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:26:22 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:26:22 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:26:22 user nova-compute[75993]:   </clock>
Nov 08 22:26:22 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:26:22 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:26:22 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:26:22 user nova-compute[75993]:   </cpu>
Nov 08 22:26:22 user nova-compute[75993]:   <devices>
Nov 08 22:26:22 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 22:26:22 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:26:22 user nova-compute[75993]:       <source dev="/dev/sdb"/>
Nov 08 22:26:22 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:26:22 user nova-compute[75993]:       <serial>a4852d97-3bb7-47bb-8e1e-e96bb215c036</serial>
Nov 08 22:26:22 user nova-compute[75993]:     </disk>
Nov 08 22:26:22 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:26:22 user nova-compute[75993]:       <mac address="fa:16:3e:14:9d:93"/>
Nov 08 22:26:22 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:26:22 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:26:22 user nova-compute[75993]:       <target dev="tapf98843f7-9b"/>
Nov 08 22:26:22 user nova-compute[75993]:     </interface>
Nov 08 22:26:22 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:26:22 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/4f5a0081-40d0-4b65-aff7-cd8f8aa8e215/console.log" append="off"/>
Nov 08 22:26:22 user nova-compute[75993]:     </serial>
Nov 08 22:26:22 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:26:22 user nova-compute[75993]:     <video>
Nov 08 22:26:22 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:26:22 user nova-compute[75993]:     </video>
Nov 08 22:26:22 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:26:22 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:26:22 user nova-compute[75993]:     </rng>
Nov 08 22:26:22 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:26:22 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:26:22 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:26:22 user nova-compute[75993]:     </memballoon>
Nov 08 22:26:22 user nova-compute[75993]:   </devices>
Nov 08 22:26:22 user nova-compute[75993]: </domain>
Nov 08 22:26:22 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1814404889',display_name='tempest-TestVolumeBootPattern-server-1814404889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1814404889',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtqgsG6SU0vF+HBwuY1w6anz7HT7ETGYSZ+dcW0ZWCVczHSpVsOGu3TwvVBpDTX6Z9hhqRptung3GUpoJgwg+8wpGEqUivf7YEwSNsT7kqzGjH87a2psJQ1CWH9W+Z7w==',key_name='tempest-TestVolumeBootPattern-662113852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-jbn4viao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:25:59Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=4f5a0081-40d0-4b65-aff7-cd8f8aa8e215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:9d:93,bridge_name='br-int',has_traffic_filtering=True,id=f98843f7-9b57-4fde-9e2e-a029f9d0ef24,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98843f7-9b') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG os_vif [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:9d:93,bridge_name='br-int',has_traffic_filtering=True,id=f98843f7-9b57-4fde-9e2e-a029f9d0ef24,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98843f7-9b') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27c7eb27-c356-5c0a-b41d-e7955d6d333d', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf98843f7-9b, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf98843f7-9b, col_values=(('qos', UUID('967d243c-c285-4774-a42f-8321f11a3401')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf98843f7-9b, col_values=(('external_ids', {'iface-id': 'f98843f7-9b57-4fde-9e2e-a029f9d0ef24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:9d:93', 'vm-uuid': '4f5a0081-40d0-4b65-aff7-cd8f8aa8e215'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:22 user nova-compute[75993]: INFO os_vif [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:9d:93,bridge_name='br-int',has_traffic_filtering=True,id=f98843f7-9b57-4fde-9e2e-a029f9d0ef24,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98843f7-9b')
Nov 08 22:26:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:26:22 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No VIF found with MAC fa:16:3e:14:9d:93, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:26:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-7a3e2cde-3c20-4438-8af9-3e8320f8e356 req-e1ccce00-3db0-4800-a037-27546068a8fd service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Received event network-vif-plugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:26:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7a3e2cde-3c20-4438-8af9-3e8320f8e356 req-e1ccce00-3db0-4800-a037-27546068a8fd service nova] Acquiring lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7a3e2cde-3c20-4438-8af9-3e8320f8e356 req-e1ccce00-3db0-4800-a037-27546068a8fd service nova] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:24 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-7a3e2cde-3c20-4438-8af9-3e8320f8e356 req-e1ccce00-3db0-4800-a037-27546068a8fd service nova] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:24 user nova-compute[75993]: DEBUG nova.compute.manager [req-7a3e2cde-3c20-4438-8af9-3e8320f8e356 req-e1ccce00-3db0-4800-a037-27546068a8fd service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] No waiting events found dispatching network-vif-plugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:26:24 user nova-compute[75993]: WARNING nova.compute.manager [req-7a3e2cde-3c20-4438-8af9-3e8320f8e356 req-e1ccce00-3db0-4800-a037-27546068a8fd service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Received unexpected event network-vif-plugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 for instance with vm_state building and task_state spawning.
Nov 08 22:26:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:26:26 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Instance spawned successfully.
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-eb0d3a99-18d3-4db3-83c1-030341da6617 req-7514f96b-fee8-49b7-8876-af76924dee2e service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Received event network-vif-plugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eb0d3a99-18d3-4db3-83c1-030341da6617 req-7514f96b-fee8-49b7-8876-af76924dee2e service nova] Acquiring lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eb0d3a99-18d3-4db3-83c1-030341da6617 req-7514f96b-fee8-49b7-8876-af76924dee2e service nova] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-eb0d3a99-18d3-4db3-83c1-030341da6617 req-7514f96b-fee8-49b7-8876-af76924dee2e service nova] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.compute.manager [req-eb0d3a99-18d3-4db3-83c1-030341da6617 req-7514f96b-fee8-49b7-8876-af76924dee2e service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] No waiting events found dispatching network-vif-plugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:26:26 user nova-compute[75993]: WARNING nova.compute.manager [req-eb0d3a99-18d3-4db3-83c1-030341da6617 req-7514f96b-fee8-49b7-8876-af76924dee2e service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Received unexpected event network-vif-plugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 for instance with vm_state building and task_state spawning.
Nov 08 22:26:26 user nova-compute[75993]: INFO nova.compute.manager [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 08 22:26:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:26:26 user nova-compute[75993]: INFO nova.compute.manager [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Took 28.33 seconds to build instance.
Nov 08 22:26:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-1bcaaa79-f381-44a2-8615-ecc76519ba1f tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.461s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:30 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:26:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:33 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:26:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:26:33 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:26:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:26:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:26:33 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:26:33 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:26:34 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Updating instance_info_cache with network_info: [{"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:26:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:26:34 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:26:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:38 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:26:38 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:26:39 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:26:39 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:26:39 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:26:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:39 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:26:39 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:39 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:39 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:26:40 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:26:40 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:26:40 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8705MB free_disk=24.94919204711914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance eadd1e8f-5e46-4469-894e-21d24933a5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:26:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:26:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:26:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:26:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:26:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:26:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:27:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:27:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:27:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:27:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:27:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:27:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:27:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:27:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:27:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:27:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:27:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:27:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:35 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:27:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:27:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:27:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:27:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:27:35 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Updating instance_info_cache with network_info: [{"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:27:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:27:35 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:27:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:27:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:27:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:38 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:27:40 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:27:40 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:27:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:27:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:27:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:27:40 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:27:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:40 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:27:41 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:27:41 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:27:41 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=24.948307037353516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:27:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:27:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:27:41 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:27:41 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance eadd1e8f-5e46-4469-894e-21d24933a5c1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:27:41 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:27:41 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:27:41 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:27:41 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:27:41 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:27:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:27:42 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:27:42 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:27:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:27:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:27:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:27:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:27:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:27:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:27:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-79121a51-f4fe-4f61-b1e9-413c6ff0d53b req-321fda85-8699-4f5e-a98d-874590e07d81 service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Received event network-changed-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-79121a51-f4fe-4f61-b1e9-413c6ff0d53b req-321fda85-8699-4f5e-a98d-874590e07d81 service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Refreshing instance network info cache due to event network-changed-f98843f7-9b57-4fde-9e2e-a029f9d0ef24. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-79121a51-f4fe-4f61-b1e9-413c6ff0d53b req-321fda85-8699-4f5e-a98d-874590e07d81 service nova] Acquiring lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-79121a51-f4fe-4f61-b1e9-413c6ff0d53b req-321fda85-8699-4f5e-a98d-874590e07d81 service nova] Acquired lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG nova.network.neutron [req-79121a51-f4fe-4f61-b1e9-413c6ff0d53b req-321fda85-8699-4f5e-a98d-874590e07d81 service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Refreshing network info cache for port f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG nova.network.neutron [req-79121a51-f4fe-4f61-b1e9-413c6ff0d53b req-321fda85-8699-4f5e-a98d-874590e07d81 service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Updated VIF entry in instance network info cache for port f98843f7-9b57-4fde-9e2e-a029f9d0ef24. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG nova.network.neutron [req-79121a51-f4fe-4f61-b1e9-413c6ff0d53b req-321fda85-8699-4f5e-a98d-874590e07d81 service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Updating instance_info_cache with network_info: [{"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-79121a51-f4fe-4f61-b1e9-413c6ff0d53b req-321fda85-8699-4f5e-a98d-874590e07d81 service nova] Releasing lock "refresh_cache-4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:27:50 user nova-compute[75993]: INFO nova.compute.manager [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Terminating instance
Nov 08 22:27:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-3a85b729-89f2-43c5-8932-2f826f65a317 req-2f19bdcd-5572-4182-a8ef-03e7d9db3812 service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Received event network-vif-unplugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3a85b729-89f2-43c5-8932-2f826f65a317 req-2f19bdcd-5572-4182-a8ef-03e7d9db3812 service nova] Acquiring lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3a85b729-89f2-43c5-8932-2f826f65a317 req-2f19bdcd-5572-4182-a8ef-03e7d9db3812 service nova] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-3a85b729-89f2-43c5-8932-2f826f65a317 req-2f19bdcd-5572-4182-a8ef-03e7d9db3812 service nova] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-3a85b729-89f2-43c5-8932-2f826f65a317 req-2f19bdcd-5572-4182-a8ef-03e7d9db3812 service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] No waiting events found dispatching network-vif-unplugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:27:50 user nova-compute[75993]: DEBUG nova.compute.manager [req-3a85b729-89f2-43c5-8932-2f826f65a317 req-2f19bdcd-5572-4182-a8ef-03e7d9db3812 service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Received event network-vif-unplugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Instance destroyed successfully.
Nov 08 22:27:51 user nova-compute[75993]: DEBUG nova.objects.instance [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'resources' on Instance uuid 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:25:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1814404889',display_name='tempest-TestVolumeBootPattern-server-1814404889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1814404889',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtqgsG6SU0vF+HBwuY1w6anz7HT7ETGYSZ+dcW0ZWCVczHSpVsOGu3TwvVBpDTX6Z9hhqRptung3GUpoJgwg+8wpGEqUivf7YEwSNsT7kqzGjH87a2psJQ1CWH9W+Z7w==',key_name='tempest-TestVolumeBootPattern-662113852',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:26:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-jbn4viao',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:26:26Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=4f5a0081-40d0-4b65-aff7-cd8f8aa8e215,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "address": "fa:16:3e:14:9d:93", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf98843f7-9b", "ovs_interfaceid": "f98843f7-9b57-4fde-9e2e-a029f9d0ef24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:9d:93,bridge_name='br-int',has_traffic_filtering=True,id=f98843f7-9b57-4fde-9e2e-a029f9d0ef24,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98843f7-9b') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_vif [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:9d:93,bridge_name='br-int',has_traffic_filtering=True,id=f98843f7-9b57-4fde-9e2e-a029f9d0ef24,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98843f7-9b') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf98843f7-9b, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=967d243c-c285-4774-a42f-8321f11a3401) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: INFO os_vif [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:9d:93,bridge_name='br-int',has_traffic_filtering=True,id=f98843f7-9b57-4fde-9e2e-a029f9d0ef24,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf98843f7-9b')
Nov 08 22:27:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhycXqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:27:51 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3605fc-5dcb-4112-9a32-c46231edbe6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:27:51 user nova-compute[75993]: No targets found.
Nov 08 22:27:51 user nova-compute[75993]: iSNS:
Nov 08 22:27:51 user nova-compute[75993]: No targets found.
Nov 08 22:27:51 user nova-compute[75993]: STATIC:
Nov 08 22:27:51 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036
Nov 08 22:27:51 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:27:51 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:27:51 user nova-compute[75993]: FIRMWARE:
Nov 08 22:27:51 user nova-compute[75993]: No targets found.
Nov 08 22:27:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:27:51 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:27:51 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1a964d-9fcc-4088-bd10-3e4ee4e9f750]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[51028573-4c66-4f90-88f7-c89e243fb320]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:27:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:27:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544df12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[703b1fee-273e-416a-b20d-23c84079f30a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c4a196-2339-4c35-847c-d5f41fbc4730]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[200573a7-ff29-4347-8abf-a0af3d6320ce]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dd1646-8503-4e1d-b102-ca2fe8fd73b3]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9759c99-42fb-4440-a422-83451d945c3c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5901a52c-1054-4946-ad3b-c6a497ae4602]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260]
Nov 08 22:27:51 user nova-compute[75993]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260] successful.
Nov 08 22:27:51 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b209d6e-2d41-49ba-8994-356b0a6cfb05]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== disconnect_volume: return (328ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:27:51 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Deleting instance files /opt/stack/data/nova/instances/4f5a0081-40d0-4b65-aff7-cd8f8aa8e215_del
Nov 08 22:27:51 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Deletion of /opt/stack/data/nova/instances/4f5a0081-40d0-4b65-aff7-cd8f8aa8e215_del complete
Nov 08 22:27:51 user nova-compute[75993]: INFO nova.compute.manager [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 08 22:27:51 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:52 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:27:52 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Took 0.66 seconds to deallocate network for instance.
Nov 08 22:27:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-6e14467b-61e2-4cc3-a322-3049e8d35a17 req-e5e1e99a-7992-4e3e-9071-2082c5f528ed service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Received event network-vif-deleted-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:27:52 user nova-compute[75993]: INFO nova.compute.manager [req-6e14467b-61e2-4cc3-a322-3049e8d35a17 req-e5e1e99a-7992-4e3e-9071-2082c5f528ed service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Neutron deleted interface f98843f7-9b57-4fde-9e2e-a029f9d0ef24; detaching it from the instance and deleting it from the info cache
Nov 08 22:27:52 user nova-compute[75993]: DEBUG nova.network.neutron [req-6e14467b-61e2-4cc3-a322-3049e8d35a17 req-e5e1e99a-7992-4e3e-9071-2082c5f528ed service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:27:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-6e14467b-61e2-4cc3-a322-3049e8d35a17 req-e5e1e99a-7992-4e3e-9071-2082c5f528ed service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Detach interface failed, port_id=f98843f7-9b57-4fde-9e2e-a029f9d0ef24, reason: Instance 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215 could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 22:27:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-98797e34-0c12-4abb-acd6-1452238b09e4 req-45c3f9bf-0b52-4579-920c-14585e83154a service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Received event network-vif-plugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:27:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-98797e34-0c12-4abb-acd6-1452238b09e4 req-45c3f9bf-0b52-4579-920c-14585e83154a service nova] Acquiring lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:27:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-98797e34-0c12-4abb-acd6-1452238b09e4 req-45c3f9bf-0b52-4579-920c-14585e83154a service nova] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:27:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-98797e34-0c12-4abb-acd6-1452238b09e4 req-45c3f9bf-0b52-4579-920c-14585e83154a service nova] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:27:52 user nova-compute[75993]: DEBUG nova.compute.manager [req-98797e34-0c12-4abb-acd6-1452238b09e4 req-45c3f9bf-0b52-4579-920c-14585e83154a service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] No waiting events found dispatching network-vif-plugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:27:52 user nova-compute[75993]: WARNING nova.compute.manager [req-98797e34-0c12-4abb-acd6-1452238b09e4 req-45c3f9bf-0b52-4579-920c-14585e83154a service nova] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Received unexpected event network-vif-plugged-f98843f7-9b57-4fde-9e2e-a029f9d0ef24 for instance with vm_state active and task_state deleting.
Nov 08 22:27:53 user nova-compute[75993]: INFO nova.compute.manager [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215] Took 0.94 seconds to detach 1 volumes for instance.
Nov 08 22:27:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:27:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:27:53 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:27:53 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:27:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:27:53 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Deleted allocations for instance 4f5a0081-40d0-4b65-aff7-cd8f8aa8e215
Nov 08 22:27:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-267fa6f6-d7da-4355-8d3f-e1e11689e7bf tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "4f5a0081-40d0-4b65-aff7-cd8f8aa8e215" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.207s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:27:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:27:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-c46397cf-da26-4940-8a93-d01235294c62 req-66b26219-a58c-45a2-b9f4-038d2a3b0f2a service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Received event network-changed-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:27:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-c46397cf-da26-4940-8a93-d01235294c62 req-66b26219-a58c-45a2-b9f4-038d2a3b0f2a service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Refreshing instance network info cache due to event network-changed-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:27:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c46397cf-da26-4940-8a93-d01235294c62 req-66b26219-a58c-45a2-b9f4-038d2a3b0f2a service nova] Acquiring lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:27:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c46397cf-da26-4940-8a93-d01235294c62 req-66b26219-a58c-45a2-b9f4-038d2a3b0f2a service nova] Acquired lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:27:58 user nova-compute[75993]: DEBUG nova.network.neutron [req-c46397cf-da26-4940-8a93-d01235294c62 req-66b26219-a58c-45a2-b9f4-038d2a3b0f2a service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Refreshing network info cache for port 642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:27:59 user nova-compute[75993]: DEBUG nova.network.neutron [req-c46397cf-da26-4940-8a93-d01235294c62 req-66b26219-a58c-45a2-b9f4-038d2a3b0f2a service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Updated VIF entry in instance network info cache for port 642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:27:59 user nova-compute[75993]: DEBUG nova.network.neutron [req-c46397cf-da26-4940-8a93-d01235294c62 req-66b26219-a58c-45a2-b9f4-038d2a3b0f2a service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Updating instance_info_cache with network_info: [{"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:27:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-c46397cf-da26-4940-8a93-d01235294c62 req-66b26219-a58c-45a2-b9f4-038d2a3b0f2a service nova] Releasing lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:28:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:28:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG nova.objects.instance [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'flavor' on Instance uuid eadd1e8f-5e46-4469-894e-21d24933a5c1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:28:04 user nova-compute[75993]: INFO nova.compute.manager [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Attaching volume ef2bb96e-5519-4221-a76a-deca1be1c519 to /dev/vdb
Nov 08 22:28:04 user nova-compute[75993]: DEBUG os_brick.utils [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7179942a-bba7-42da-8846-cb246abfe7cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[813c1047-9ade-4267-8c9b-22db8f518029]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[026e9553-61f4-457a-b4b4-592c992c21f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5541cc29-74dd-4da6-848b-1990f8316617]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:04 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:28:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:28:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:28:05 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:28:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e2e311-a65a-4488-a27f-b05df4289de2]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:28:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:28:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:28:05 user nova-compute[75993]: DEBUG os_brick.utils [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:28:05 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Updating existing volume attachment record: f9869f58-c37f-4d30-8acd-8115e5496e96 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:28:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oiLMEvKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:28:26 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:28:26 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:28:26 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa2310c-6d4d-438a-bbc6-b553bdb531ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:28:26 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e027647-f91b-48fa-9b8e-605dc1dcda13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519] added
Nov 08 22:28:26 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67b4438-1920-4f9a-a482-8fab51e331cd]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41e341f-0347-4fef-b799-e5afd7015398]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oiLMEvKz {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oiLMEvKz" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ba23d2-2766-42be-82f2-0244ee16ac49]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oiLMEvKz'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5109d64d-5919-4ab4-8f5e-12cc7f9e647a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff9879d-ffcb-4288-b6bf-5769cec526ce]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:28:26 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:28:26 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:28:26 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:28:26 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 22:28:26 user nova-compute[75993]: 
Nov 08 22:28:26 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba82920-9959-40b5-9dd4-de08bf275491]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519, portal: 172.16.0.220,3260]
Nov 08 22:28:27 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519, portal: 172.16.0.220,3260] successful.
Nov 08 22:28:27 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c4058c-b21e-4119-9cfc-e0abd4f83c4b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f0e8a1-a6ff-47e1-acfa-ccf4b4b825ea]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 (non-flash)
Nov 08 22:28:27 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 (non-flash)
Nov 08 22:28:27 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bcf3eb-9a84-4d29-bf15-e3c010bea9f8]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:28:27 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oiLMEvKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:28:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:28:28 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23132333933383137', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:28:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132333933383137', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:28:28 user nova-compute[75993]: DEBUG nova.objects.instance [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'flavor' on Instance uuid eadd1e8f-5e46-4469-894e-21d24933a5c1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:28:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 22:28:28 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:28:28 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:28:28 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:28:28 user nova-compute[75993]:   <serial>ef2bb96e-5519-4221-a76a-deca1be1c519</serial>
Nov 08 22:28:28 user nova-compute[75993]: </disk>
Nov 08 22:28:28 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 22:28:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:28:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:28:28 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No VIF found with MAC fa:16:3e:d9:6a:85, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:28:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-c26414c9-86af-4c95-9d29-e3c6d78f2f4d tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.830s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:28:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:28:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:28:29 user nova-compute[75993]: INFO nova.compute.manager [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Detaching volume ef2bb96e-5519-4221-a76a-deca1be1c519
Nov 08 22:28:29 user nova-compute[75993]: INFO nova.virt.block_device [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Attempting to driver detach volume ef2bb96e-5519-4221-a76a-deca1be1c519 from mountpoint /dev/vdb
Nov 08 22:28:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Attempting to detach device vdb from instance eadd1e8f-5e46-4469-894e-21d24933a5c1 from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 22:28:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:28:29 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:28:29 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:28:29 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:28:29 user nova-compute[75993]:   <serial>ef2bb96e-5519-4221-a76a-deca1be1c519</serial>
Nov 08 22:28:29 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:28:29 user nova-compute[75993]: </disk>
Nov 08 22:28:29 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:28:29 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully detached device vdb from instance eadd1e8f-5e46-4469-894e-21d24933a5c1 from the persistent domain config.
Nov 08 22:28:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eadd1e8f-5e46-4469-894e-21d24933a5c1 from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 22:28:29 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:28:29 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:28:29 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:28:29 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:28:29 user nova-compute[75993]:   <serial>ef2bb96e-5519-4221-a76a-deca1be1c519</serial>
Nov 08 22:28:29 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:28:29 user nova-compute[75993]: </disk>
Nov 08 22:28:29 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:28:30 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eadd1e8f-5e46-4469-894e-21d24933a5c1 {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 22:28:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:31 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:28:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:36 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:28:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:28:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:28:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:28:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:28:36 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:28:36 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid eadd1e8f-5e46-4469-894e-21d24933a5c1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:28:37 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Updating instance_info_cache with network_info: [{"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:28:37 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-eadd1e8f-5e46-4469-894e-21d24933a5c1" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:28:37 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:28:39 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:41 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:28:42 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:28:42 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8890MB free_disk=24.946765899658203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance eadd1e8f-5e46-4469-894e-21d24933a5c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 2299c8b0-2e55-4679-bde2-a32d1119f1c4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.134s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:28:42 user nova-compute[75993]: INFO nova.compute.claims [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Claim successful on node user
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.network.neutron [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:28:42 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:28:42 user nova-compute[75993]: DEBUG nova.policy [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4d2f038c60247b894c8849ee3b9183b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef08c827c91436bb907130af0c4f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:28:43 user nova-compute[75993]: INFO nova.virt.block_device [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Booting with volume a4852d97-3bb7-47bb-8e1e-e96bb215c036 at /dev/vda
Nov 08 22:28:43 user nova-compute[75993]: DEBUG os_brick.utils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78be8d1-fbef-4ab6-b941-4c8f8a6adc6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a2d7eb-adff-456f-9dfd-eafbbec31e02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb4aa4b-2929-4972-9094-3300e18620ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50c491d-1784-4010-a4fb-1f4050ece359]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:28:43 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05a4268-a447-4744-a36a-0bed651469b1]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG os_brick.utils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updating existing volume attachment record: 9bc4a085-54ca-4b2b-b1de-2b67b3805986 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:28:43 user nova-compute[75993]: DEBUG nova.network.neutron [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Successfully created port: 18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG nova.network.neutron [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Successfully updated port: 18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquired lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG nova.network.neutron [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-d68d9011-7af7-4367-9dae-c279f0ca17ce req-4ce1593a-158c-4e46-a157-cd725e17ad39 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received event network-changed-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-d68d9011-7af7-4367-9dae-c279f0ca17ce req-4ce1593a-158c-4e46-a157-cd725e17ad39 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Refreshing instance network info cache due to event network-changed-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d68d9011-7af7-4367-9dae-c279f0ca17ce req-4ce1593a-158c-4e46-a157-cd725e17ad39 service nova] Acquiring lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG nova.network.neutron [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG nova.network.neutron [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updating instance_info_cache with network_info: [{"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Releasing lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Instance network_info: |[{"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d68d9011-7af7-4367-9dae-c279f0ca17ce req-4ce1593a-158c-4e46-a157-cd725e17ad39 service nova] Acquired lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:28:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-d68d9011-7af7-4367-9dae-c279f0ca17ce req-4ce1593a-158c-4e46-a157-cd725e17ad39 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Refreshing network info cache for port 18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:28:45 user nova-compute[75993]: DEBUG nova.network.neutron [req-d68d9011-7af7-4367-9dae-c279f0ca17ce req-4ce1593a-158c-4e46-a157-cd725e17ad39 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updated VIF entry in instance network info cache for port 18ea8a14-d0f5-4b66-a0fc-3c1c0b774177. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:28:45 user nova-compute[75993]: DEBUG nova.network.neutron [req-d68d9011-7af7-4367-9dae-c279f0ca17ce req-4ce1593a-158c-4e46-a157-cd725e17ad39 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updating instance_info_cache with network_info: [{"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:28:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-d68d9011-7af7-4367-9dae-c279f0ca17ce req-4ce1593a-158c-4e46-a157-cd725e17ad39 service nova] Releasing lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:28:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:28:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:28:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:28:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:28:50 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eadd1e8f-5e46-4469-894e-21d24933a5c1 is timed out.
Nov 08 22:28:50 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully detached device vdb from instance eadd1e8f-5e46-4469-894e-21d24933a5c1 from the live domain config.
Nov 08 22:28:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oiLMEvKz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:28:50 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bf7905-5611-4d06-84bb-a02b49f10d15]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:28:50 user nova-compute[75993]: No targets found.
Nov 08 22:28:50 user nova-compute[75993]: iSNS:
Nov 08 22:28:50 user nova-compute[75993]: No targets found.
Nov 08 22:28:50 user nova-compute[75993]: STATIC:
Nov 08 22:28:50 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519
Nov 08 22:28:50 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:28:50 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:28:50 user nova-compute[75993]: FIRMWARE:
Nov 08 22:28:50 user nova-compute[75993]: No targets found.
Nov 08 22:28:50 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:28:50 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:28:50 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06e31c5-d7ac-46ce-8f68-7415c5a928c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b24bdf5-000f-42a4-b975-c9077c7ca5d4]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 (non-flash)
Nov 08 22:28:50 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 (non-flash)
Nov 08 22:28:50 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544bcbeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1caf032e-549e-40cd-9ac7-7c5e63780c59]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[056a48c4-adac-4f89-82b1-8b839614bb5e]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d268efe-4317-47bd-b117-c1659bcc90a9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a929a677-10dc-44b4-a1a0-7ec14efd6d8e]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f95abc-5676-4173-b534-112e8b0f87ff]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72af38c-b7e0-4db5-a9d1-2bf9454cbd6c]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519, portal: 172.16.0.220,3260]
Nov 08 22:28:50 user nova-compute[75993]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519, portal: 172.16.0.220,3260] successful.
Nov 08 22:28:50 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef2bb96e-5519-4221-a76a-deca1be1c519 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0225c72-b69d-445b-90ab-8e2736c8e96b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] <== disconnect_volume: return (276ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:28:50 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:28:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:28:51 user nova-compute[75993]: DEBUG nova.objects.instance [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'flavor' on Instance uuid eadd1e8f-5e46-4469-894e-21d24933a5c1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:28:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-efc54388-60e2-4fed-9650-894e1b7fa52b tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.870s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:28:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:29:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:03 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.compute.manager [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:29:05 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Creating image(s)
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Ensure instance console log exists: /opt/stack/data/nova/instances/2299c8b0-2e55-4679-bde2-a32d1119f1c4/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Start _get_guest_xml network_info=[{"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': '9bc4a085-54ca-4b2b-b1de-2b67b3805986', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhycXqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2299c8b0-2e55-4679-bde2-a32d1119f1c4', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4852d97-3bb7-47bb-8e1e-e96bb215c036', 'serial': 'a4852d97-3bb7-47bb-8e1e-e96bb215c036'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:29:05 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:29:05 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhycXqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:29:05 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:29:05 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:29:05 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b2783a-aa85-47bf-9c0a-675381413b6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:29:05 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[65525580-9fb5-4ab8-8a3c-5e734e351a39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036] added
Nov 08 22:29:05 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[345512d0-9598-49ef-ab38-98c6d893ec60]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94fcbc4-2888-4367-8be1-86abdf445253]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDhycXqT {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BDhycXqT" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8833b8b4-9a53-4728-b77d-2a6e2aa7139f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BDhycXqT'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[afea9a6f-130c-4d38-b2fe-c4b3016b443b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b145e75d-2880-4720-9618-6dbef91b891c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:29:05 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:29:05 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:29:05 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 22:29:05 user nova-compute[75993]: 
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[860d5c07-2a6b-47bf-8a68-50ee860c85a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260]
Nov 08 22:29:05 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260] successful.
Nov 08 22:29:05 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[093f1fdb-a2c9-4f0f-84eb-1959c9d038d5]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe49186-81b1-4ad9-9f2c-c7e19e001e1f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:29:05 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:29:05 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[401cfd20-bdab-4a00-9726-395fa8e62fe2]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:29:05 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhycXqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:29:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:29:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23366373639636263', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:29:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366373639636263', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:29:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-526388677',display_name='tempest-TestVolumeBootPattern-server-526388677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-526388677',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtqgsG6SU0vF+HBwuY1w6anz7HT7ETGYSZ+dcW0ZWCVczHSpVsOGu3TwvVBpDTX6Z9hhqRptung3GUpoJgwg+8wpGEqUivf7YEwSNsT7kqzGjH87a2psJQ1CWH9W+Z7w==',key_name='tempest-TestVolumeBootPattern-662113852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-y2d5qn00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:28:43Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=2299c8b0-2e55-4679-bde2-a32d1119f1c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:29:06 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:29:06 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:54:c5,bridge_name='br-int',has_traffic_filtering=True,id=18ea8a14-d0f5-4b66-a0fc-3c1c0b774177,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ea8a14-d0') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:29:06 user nova-compute[75993]: DEBUG nova.objects.instance [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'pci_devices' on Instance uuid 2299c8b0-2e55-4679-bde2-a32d1119f1c4 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:29:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:29:06 user nova-compute[75993]:   <uuid>2299c8b0-2e55-4679-bde2-a32d1119f1c4</uuid>
Nov 08 22:29:06 user nova-compute[75993]:   <name>instance-00000031</name>
Nov 08 22:29:06 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:29:06 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:29:06 user nova-compute[75993]:   <metadata>
Nov 08 22:29:06 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:29:06 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:29:06 user nova-compute[75993]:       <nova:name>tempest-TestVolumeBootPattern-server-526388677</nova:name>
Nov 08 22:29:06 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:29:05</nova:creationTime>
Nov 08 22:29:06 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:29:06 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:29:06 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:29:06 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:29:06 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:29:06 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:29:06 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:29:06 user nova-compute[75993]:       <nova:owner>
Nov 08 22:29:06 user nova-compute[75993]:         <nova:user uuid="e4d2f038c60247b894c8849ee3b9183b">tempest-TestVolumeBootPattern-1717039666-project-member</nova:user>
Nov 08 22:29:06 user nova-compute[75993]:         <nova:project uuid="9ef08c827c91436bb907130af0c4f031">tempest-TestVolumeBootPattern-1717039666</nova:project>
Nov 08 22:29:06 user nova-compute[75993]:       </nova:owner>
Nov 08 22:29:06 user nova-compute[75993]:       <nova:ports>
Nov 08 22:29:06 user nova-compute[75993]:         <nova:port uuid="18ea8a14-d0f5-4b66-a0fc-3c1c0b774177">
Nov 08 22:29:06 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 08 22:29:06 user nova-compute[75993]:         </nova:port>
Nov 08 22:29:06 user nova-compute[75993]:       </nova:ports>
Nov 08 22:29:06 user nova-compute[75993]:     </nova:instance>
Nov 08 22:29:06 user nova-compute[75993]:   </metadata>
Nov 08 22:29:06 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:29:06 user nova-compute[75993]:     <system>
Nov 08 22:29:06 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:29:06 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:29:06 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:29:06 user nova-compute[75993]:       <entry name="serial">2299c8b0-2e55-4679-bde2-a32d1119f1c4</entry>
Nov 08 22:29:06 user nova-compute[75993]:       <entry name="uuid">2299c8b0-2e55-4679-bde2-a32d1119f1c4</entry>
Nov 08 22:29:06 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:29:06 user nova-compute[75993]:     </system>
Nov 08 22:29:06 user nova-compute[75993]:   </sysinfo>
Nov 08 22:29:06 user nova-compute[75993]:   <os>
Nov 08 22:29:06 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:29:06 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:29:06 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:29:06 user nova-compute[75993]:   </os>
Nov 08 22:29:06 user nova-compute[75993]:   <features>
Nov 08 22:29:06 user nova-compute[75993]:     <acpi/>
Nov 08 22:29:06 user nova-compute[75993]:     <apic/>
Nov 08 22:29:06 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:29:06 user nova-compute[75993]:   </features>
Nov 08 22:29:06 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:29:06 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:29:06 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:29:06 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:29:06 user nova-compute[75993]:   </clock>
Nov 08 22:29:06 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:29:06 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:29:06 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:29:06 user nova-compute[75993]:   </cpu>
Nov 08 22:29:06 user nova-compute[75993]:   <devices>
Nov 08 22:29:06 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 22:29:06 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:29:06 user nova-compute[75993]:       <source dev="/dev/sdb"/>
Nov 08 22:29:06 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:29:06 user nova-compute[75993]:       <serial>a4852d97-3bb7-47bb-8e1e-e96bb215c036</serial>
Nov 08 22:29:06 user nova-compute[75993]:     </disk>
Nov 08 22:29:06 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:29:06 user nova-compute[75993]:       <mac address="fa:16:3e:26:54:c5"/>
Nov 08 22:29:06 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:29:06 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:29:06 user nova-compute[75993]:       <target dev="tap18ea8a14-d0"/>
Nov 08 22:29:06 user nova-compute[75993]:     </interface>
Nov 08 22:29:06 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:29:06 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/2299c8b0-2e55-4679-bde2-a32d1119f1c4/console.log" append="off"/>
Nov 08 22:29:06 user nova-compute[75993]:     </serial>
Nov 08 22:29:06 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:29:06 user nova-compute[75993]:     <video>
Nov 08 22:29:06 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:29:06 user nova-compute[75993]:     </video>
Nov 08 22:29:06 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:29:06 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:29:06 user nova-compute[75993]:     </rng>
Nov 08 22:29:06 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:29:06 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:29:06 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:29:06 user nova-compute[75993]:     </memballoon>
Nov 08 22:29:06 user nova-compute[75993]:   </devices>
Nov 08 22:29:06 user nova-compute[75993]: </domain>
Nov 08 22:29:06 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-526388677',display_name='tempest-TestVolumeBootPattern-server-526388677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-526388677',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtqgsG6SU0vF+HBwuY1w6anz7HT7ETGYSZ+dcW0ZWCVczHSpVsOGu3TwvVBpDTX6Z9hhqRptung3GUpoJgwg+8wpGEqUivf7YEwSNsT7kqzGjH87a2psJQ1CWH9W+Z7w==',key_name='tempest-TestVolumeBootPattern-662113852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-y2d5qn00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:28:43Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=2299c8b0-2e55-4679-bde2-a32d1119f1c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:54:c5,bridge_name='br-int',has_traffic_filtering=True,id=18ea8a14-d0f5-4b66-a0fc-3c1c0b774177,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ea8a14-d0') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG os_vif [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:54:c5,bridge_name='br-int',has_traffic_filtering=True,id=18ea8a14-d0f5-4b66-a0fc-3c1c0b774177,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ea8a14-d0') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee049c54-2e3e-568b-a02a-a4dc10e9b318', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18ea8a14-d0, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18ea8a14-d0, col_values=(('qos', UUID('78b286c3-d991-413a-98bd-8878be808d18')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18ea8a14-d0, col_values=(('external_ids', {'iface-id': '18ea8a14-d0f5-4b66-a0fc-3c1c0b774177', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:54:c5', 'vm-uuid': '2299c8b0-2e55-4679-bde2-a32d1119f1c4'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:07 user nova-compute[75993]: INFO os_vif [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:54:c5,bridge_name='br-int',has_traffic_filtering=True,id=18ea8a14-d0f5-4b66-a0fc-3c1c0b774177,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ea8a14-d0')
Nov 08 22:29:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:29:07 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No VIF found with MAC fa:16:3e:26:54:c5, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:29:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:08 user nova-compute[75993]: DEBUG nova.compute.manager [req-ef638bd9-1cba-4566-9222-82120f6e680f req-a385592a-5f8d-4e28-b51d-3d237196f7cf service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received event network-vif-plugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:29:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ef638bd9-1cba-4566-9222-82120f6e680f req-a385592a-5f8d-4e28-b51d-3d237196f7cf service nova] Acquiring lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:29:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ef638bd9-1cba-4566-9222-82120f6e680f req-a385592a-5f8d-4e28-b51d-3d237196f7cf service nova] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:29:08 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-ef638bd9-1cba-4566-9222-82120f6e680f req-a385592a-5f8d-4e28-b51d-3d237196f7cf service nova] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:29:08 user nova-compute[75993]: DEBUG nova.compute.manager [req-ef638bd9-1cba-4566-9222-82120f6e680f req-a385592a-5f8d-4e28-b51d-3d237196f7cf service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] No waiting events found dispatching network-vif-plugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:29:08 user nova-compute[75993]: WARNING nova.compute.manager [req-ef638bd9-1cba-4566-9222-82120f6e680f req-a385592a-5f8d-4e28-b51d-3d237196f7cf service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received unexpected event network-vif-plugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 for instance with vm_state building and task_state spawning.
Nov 08 22:29:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:29:10 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Instance spawned successfully.
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:29:10 user nova-compute[75993]: INFO nova.compute.manager [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.compute.manager [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.compute.manager [req-bfcd8449-2cb3-44ad-b7fd-23bdf9438cda req-11c83a08-5871-4447-a265-b5792efb421e service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received event network-vif-plugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfcd8449-2cb3-44ad-b7fd-23bdf9438cda req-11c83a08-5871-4447-a265-b5792efb421e service nova] Acquiring lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfcd8449-2cb3-44ad-b7fd-23bdf9438cda req-11c83a08-5871-4447-a265-b5792efb421e service nova] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-bfcd8449-2cb3-44ad-b7fd-23bdf9438cda req-11c83a08-5871-4447-a265-b5792efb421e service nova] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:29:10 user nova-compute[75993]: DEBUG nova.compute.manager [req-bfcd8449-2cb3-44ad-b7fd-23bdf9438cda req-11c83a08-5871-4447-a265-b5792efb421e service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] No waiting events found dispatching network-vif-plugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:29:10 user nova-compute[75993]: WARNING nova.compute.manager [req-bfcd8449-2cb3-44ad-b7fd-23bdf9438cda req-11c83a08-5871-4447-a265-b5792efb421e service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received unexpected event network-vif-plugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 for instance with vm_state building and task_state spawning.
Nov 08 22:29:10 user nova-compute[75993]: INFO nova.compute.manager [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Took 28.21 seconds to build instance.
Nov 08 22:29:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-55d3a752-6ac2-409f-957a-c7acdcfd6cad tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.307s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:29:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:29:20 user nova-compute[75993]: INFO nova.compute.manager [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Terminating instance
Nov 08 22:29:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-28ac1cfb-a1b2-4da3-b544-7a05d39cacb7 req-db75a7f6-8759-40e3-9702-337fe26d0d5e service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Received event network-vif-unplugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-28ac1cfb-a1b2-4da3-b544-7a05d39cacb7 req-db75a7f6-8759-40e3-9702-337fe26d0d5e service nova] Acquiring lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-28ac1cfb-a1b2-4da3-b544-7a05d39cacb7 req-db75a7f6-8759-40e3-9702-337fe26d0d5e service nova] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-28ac1cfb-a1b2-4da3-b544-7a05d39cacb7 req-db75a7f6-8759-40e3-9702-337fe26d0d5e service nova] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-28ac1cfb-a1b2-4da3-b544-7a05d39cacb7 req-db75a7f6-8759-40e3-9702-337fe26d0d5e service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] No waiting events found dispatching network-vif-unplugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:29:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-28ac1cfb-a1b2-4da3-b544-7a05d39cacb7 req-db75a7f6-8759-40e3-9702-337fe26d0d5e service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Received event network-vif-unplugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:29:21 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Instance destroyed successfully.
Nov 08 22:29:21 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'resources' on Instance uuid eadd1e8f-5e46-4469-894e-21d24933a5c1 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:26:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1334016749',display_name='tempest-AttachVolumeNegativeTest-server-1334016749',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1334016749',id=48,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLqSbOnGzuGbUKGjiU1cJrtrhDXzET4VMs80Fe1LOtEAUCAbXsSUpPhsSQ5vdKURml5NiLu/ql9RxYW5i15SX3Bf+X2fl946nOCgj9sZnHUY3iaLDgDPbELEOhc8z+xKg==',key_name='tempest-keypair-1139077265',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:26:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-vhzdz72g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:26:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=eadd1e8f-5e46-4469-894e-21d24933a5c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "address": "fa:16:3e:d9:6a:85", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap642ee8eb-5d", "ovs_interfaceid": "642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:6a:85,bridge_name='br-int',has_traffic_filtering=True,id=642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642ee8eb-5d') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG os_vif [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:6a:85,bridge_name='br-int',has_traffic_filtering=True,id=642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642ee8eb-5d') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap642ee8eb-5d, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ce3212f-3975-47cf-8806-4536ff51d502) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:29:21 user nova-compute[75993]: INFO os_vif [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:6a:85,bridge_name='br-int',has_traffic_filtering=True,id=642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap642ee8eb-5d')
Nov 08 22:29:21 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Deleting instance files /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1_del
Nov 08 22:29:21 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Deletion of /opt/stack/data/nova/instances/eadd1e8f-5e46-4469-894e-21d24933a5c1_del complete
Nov 08 22:29:21 user nova-compute[75993]: INFO nova.compute.manager [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 08 22:29:21 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:29:21 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Took 0.71 seconds to deallocate network for instance.
Nov 08 22:29:21 user nova-compute[75993]: DEBUG nova.compute.manager [req-2cc27b72-93b7-40c2-9459-7e8464bb234d req-0d12d888-9fc0-4c41-b7b2-21c1423ddd2c service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Received event network-vif-deleted-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:29:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:29:22 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:29:22 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:29:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:29:22 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Deleted allocations for instance eadd1e8f-5e46-4469-894e-21d24933a5c1
Nov 08 22:29:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a624a092-5bcf-423c-9c19-93788565e22a tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:29:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-de880bc8-7943-4c75-ae40-103a553c3d77 req-87fcba4c-3ac6-4d7f-8f0e-6b8a3f7972d6 service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Received event network-vif-plugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:29:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-de880bc8-7943-4c75-ae40-103a553c3d77 req-87fcba4c-3ac6-4d7f-8f0e-6b8a3f7972d6 service nova] Acquiring lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:29:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-de880bc8-7943-4c75-ae40-103a553c3d77 req-87fcba4c-3ac6-4d7f-8f0e-6b8a3f7972d6 service nova] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:29:22 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-de880bc8-7943-4c75-ae40-103a553c3d77 req-87fcba4c-3ac6-4d7f-8f0e-6b8a3f7972d6 service nova] Lock "eadd1e8f-5e46-4469-894e-21d24933a5c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:29:22 user nova-compute[75993]: DEBUG nova.compute.manager [req-de880bc8-7943-4c75-ae40-103a553c3d77 req-87fcba4c-3ac6-4d7f-8f0e-6b8a3f7972d6 service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] No waiting events found dispatching network-vif-plugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:29:22 user nova-compute[75993]: WARNING nova.compute.manager [req-de880bc8-7943-4c75-ae40-103a553c3d77 req-87fcba4c-3ac6-4d7f-8f0e-6b8a3f7972d6 service nova] [instance: eadd1e8f-5e46-4469-894e-21d24933a5c1] Received unexpected event network-vif-plugged-642ee8eb-5dc3-4af9-89c5-c2ab81e1ad28 for instance with vm_state deleted and task_state None.
Nov 08 22:29:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:33 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:29:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:38 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:29:38 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:29:38 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:29:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:29:38 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:29:38 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:29:38 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 2299c8b0-2e55-4679-bde2-a32d1119f1c4 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:29:38 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updating instance_info_cache with network_info: [{"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:29:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:29:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:29:40 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:29:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:29:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:29:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:29:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:29:41 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:29:41 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:29:42 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:29:42 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:29:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=24.97283935546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:29:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:29:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:29:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 2299c8b0-2e55-4679-bde2-a32d1119f1c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:29:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:29:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:29:42 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:29:42 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:29:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:29:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:29:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:29:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:29:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:29:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:29:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:29:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:29:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:29:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:29:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:29:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:29:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:29:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:29:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:30:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:30:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:30:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:30:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:30:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:30:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:30:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:30:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "58f0933d-8a7d-4087-8cc0-12442621c20a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:30:14 user nova-compute[75993]: INFO nova.compute.claims [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Claim successful on node user
Nov 08 22:30:14 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:30:14 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:30:14 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:30:14 user nova-compute[75993]: DEBUG nova.policy [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be86d9fb78614dbeaaf9faa42bbf2868', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8260793f85b4fa7a83c779f7f6c58e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:30:15 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Creating image(s)
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "/opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "/opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "/opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.167s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk 1073741824" returned: 0 in 0.054s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Successfully created port: ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.178s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Cannot resize image /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Ensure instance console log exists: /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:30:15 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Successfully updated port: ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquired lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-0983db17-eaf1-42c8-88b9-4324e125a424 req-e9e888e4-2a6a-451a-ab38-3aab627ffbb8 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Received event network-changed-ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-0983db17-eaf1-42c8-88b9-4324e125a424 req-e9e888e4-2a6a-451a-ab38-3aab627ffbb8 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Refreshing instance network info cache due to event network-changed-ea4bab11-7194-4967-9a1c-a3102baa9863. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0983db17-eaf1-42c8-88b9-4324e125a424 req-e9e888e4-2a6a-451a-ab38-3aab627ffbb8 service nova] Acquiring lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Updating instance_info_cache with network_info: [{"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Releasing lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Instance network_info: |[{"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0983db17-eaf1-42c8-88b9-4324e125a424 req-e9e888e4-2a6a-451a-ab38-3aab627ffbb8 service nova] Acquired lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.network.neutron [req-0983db17-eaf1-42c8-88b9-4324e125a424 req-e9e888e4-2a6a-451a-ab38-3aab627ffbb8 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Refreshing network info cache for port ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Start _get_guest_xml network_info=[{"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:30:16 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:30:16 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1544597007',display_name='tempest-AttachVolumeNegativeTest-server-1544597007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1544597007',id=50,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdz/MPmmMvYb0oRmWKOOpaki1bZ9N8AyhZzvmQIKCsUWINmPgsjPyA/XYCGBkcjr343l9Cd/2WyqYuLeugKm660PNF4tDlkMM1xMefalynuFrzEYEwKFt7tjJO8NJLG+A==',key_name='tempest-keypair-669145117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-ei3m7z7z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=58f0933d-8a7d-4087-8cc0-12442621c20a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:35:cd,bridge_name='br-int',has_traffic_filtering=True,id=ea4bab11-7194-4967-9a1c-a3102baa9863,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4bab11-71') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'pci_devices' on Instance uuid 58f0933d-8a7d-4087-8cc0-12442621c20a {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:30:16 user nova-compute[75993]:   <uuid>58f0933d-8a7d-4087-8cc0-12442621c20a</uuid>
Nov 08 22:30:16 user nova-compute[75993]:   <name>instance-00000032</name>
Nov 08 22:30:16 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:30:16 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:30:16 user nova-compute[75993]:   <metadata>
Nov 08 22:30:16 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:30:16 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:30:16 user nova-compute[75993]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1544597007</nova:name>
Nov 08 22:30:16 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:30:16</nova:creationTime>
Nov 08 22:30:16 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:30:16 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:30:16 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:30:16 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:30:16 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:30:16 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:30:16 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:30:16 user nova-compute[75993]:       <nova:owner>
Nov 08 22:30:16 user nova-compute[75993]:         <nova:user uuid="be86d9fb78614dbeaaf9faa42bbf2868">tempest-AttachVolumeNegativeTest-1149565506-project-member</nova:user>
Nov 08 22:30:16 user nova-compute[75993]:         <nova:project uuid="b8260793f85b4fa7a83c779f7f6c58e3">tempest-AttachVolumeNegativeTest-1149565506</nova:project>
Nov 08 22:30:16 user nova-compute[75993]:       </nova:owner>
Nov 08 22:30:16 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 22:30:16 user nova-compute[75993]:       <nova:ports>
Nov 08 22:30:16 user nova-compute[75993]:         <nova:port uuid="ea4bab11-7194-4967-9a1c-a3102baa9863">
Nov 08 22:30:16 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 08 22:30:16 user nova-compute[75993]:         </nova:port>
Nov 08 22:30:16 user nova-compute[75993]:       </nova:ports>
Nov 08 22:30:16 user nova-compute[75993]:     </nova:instance>
Nov 08 22:30:16 user nova-compute[75993]:   </metadata>
Nov 08 22:30:16 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:30:16 user nova-compute[75993]:     <system>
Nov 08 22:30:16 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:30:16 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:30:16 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:30:16 user nova-compute[75993]:       <entry name="serial">58f0933d-8a7d-4087-8cc0-12442621c20a</entry>
Nov 08 22:30:16 user nova-compute[75993]:       <entry name="uuid">58f0933d-8a7d-4087-8cc0-12442621c20a</entry>
Nov 08 22:30:16 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:30:16 user nova-compute[75993]:     </system>
Nov 08 22:30:16 user nova-compute[75993]:   </sysinfo>
Nov 08 22:30:16 user nova-compute[75993]:   <os>
Nov 08 22:30:16 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:30:16 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:30:16 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:30:16 user nova-compute[75993]:   </os>
Nov 08 22:30:16 user nova-compute[75993]:   <features>
Nov 08 22:30:16 user nova-compute[75993]:     <acpi/>
Nov 08 22:30:16 user nova-compute[75993]:     <apic/>
Nov 08 22:30:16 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:30:16 user nova-compute[75993]:   </features>
Nov 08 22:30:16 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:30:16 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:30:16 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:30:16 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:30:16 user nova-compute[75993]:   </clock>
Nov 08 22:30:16 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:30:16 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:30:16 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:30:16 user nova-compute[75993]:   </cpu>
Nov 08 22:30:16 user nova-compute[75993]:   <devices>
Nov 08 22:30:16 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 22:30:16 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 22:30:16 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk"/>
Nov 08 22:30:16 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:30:16 user nova-compute[75993]:     </disk>
Nov 08 22:30:16 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:30:16 user nova-compute[75993]:       <mac address="fa:16:3e:0e:35:cd"/>
Nov 08 22:30:16 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:30:16 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:30:16 user nova-compute[75993]:       <target dev="tapea4bab11-71"/>
Nov 08 22:30:16 user nova-compute[75993]:     </interface>
Nov 08 22:30:16 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:30:16 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/console.log" append="off"/>
Nov 08 22:30:16 user nova-compute[75993]:     </serial>
Nov 08 22:30:16 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:30:16 user nova-compute[75993]:     <video>
Nov 08 22:30:16 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:30:16 user nova-compute[75993]:     </video>
Nov 08 22:30:16 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:30:16 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:30:16 user nova-compute[75993]:     </rng>
Nov 08 22:30:16 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:30:16 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:30:16 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:30:16 user nova-compute[75993]:     </memballoon>
Nov 08 22:30:16 user nova-compute[75993]:   </devices>
Nov 08 22:30:16 user nova-compute[75993]: </domain>
Nov 08 22:30:16 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1544597007',display_name='tempest-AttachVolumeNegativeTest-server-1544597007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1544597007',id=50,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdz/MPmmMvYb0oRmWKOOpaki1bZ9N8AyhZzvmQIKCsUWINmPgsjPyA/XYCGBkcjr343l9Cd/2WyqYuLeugKm660PNF4tDlkMM1xMefalynuFrzEYEwKFt7tjJO8NJLG+A==',key_name='tempest-keypair-669145117',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-ei3m7z7z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:30:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=58f0933d-8a7d-4087-8cc0-12442621c20a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:35:cd,bridge_name='br-int',has_traffic_filtering=True,id=ea4bab11-7194-4967-9a1c-a3102baa9863,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4bab11-71') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG os_vif [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:35:cd,bridge_name='br-int',has_traffic_filtering=True,id=ea4bab11-7194-4967-9a1c-a3102baa9863,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4bab11-71') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55172e0a-b6b6-5d22-8e4b-8d7f23a9e1ee', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapea4bab11-71, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapea4bab11-71, col_values=(('qos', UUID('085f62f1-159e-476f-bc69-2916ac5cbed0')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapea4bab11-71, col_values=(('external_ids', {'iface-id': 'ea4bab11-7194-4967-9a1c-a3102baa9863', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:35:cd', 'vm-uuid': '58f0933d-8a7d-4087-8cc0-12442621c20a'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:16 user nova-compute[75993]: INFO os_vif [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:35:cd,bridge_name='br-int',has_traffic_filtering=True,id=ea4bab11-7194-4967-9a1c-a3102baa9863,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4bab11-71')
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No VIF found with MAC fa:16:3e:0e:35:cd, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.network.neutron [req-0983db17-eaf1-42c8-88b9-4324e125a424 req-e9e888e4-2a6a-451a-ab38-3aab627ffbb8 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Updated VIF entry in instance network info cache for port ea4bab11-7194-4967-9a1c-a3102baa9863. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG nova.network.neutron [req-0983db17-eaf1-42c8-88b9-4324e125a424 req-e9e888e4-2a6a-451a-ab38-3aab627ffbb8 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Updating instance_info_cache with network_info: [{"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:30:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0983db17-eaf1-42c8-88b9-4324e125a424 req-e9e888e4-2a6a-451a-ab38-3aab627ffbb8 service nova] Releasing lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:30:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-43211b23-9947-453a-b631-8e33b0ecd2f9 req-c744af90-3d65-4875-a387-64ef643ae179 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Received event network-vif-plugged-ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:30:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43211b23-9947-453a-b631-8e33b0ecd2f9 req-c744af90-3d65-4875-a387-64ef643ae179 service nova] Acquiring lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:30:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43211b23-9947-453a-b631-8e33b0ecd2f9 req-c744af90-3d65-4875-a387-64ef643ae179 service nova] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:30:18 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-43211b23-9947-453a-b631-8e33b0ecd2f9 req-c744af90-3d65-4875-a387-64ef643ae179 service nova] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:30:18 user nova-compute[75993]: DEBUG nova.compute.manager [req-43211b23-9947-453a-b631-8e33b0ecd2f9 req-c744af90-3d65-4875-a387-64ef643ae179 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] No waiting events found dispatching network-vif-plugged-ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:30:18 user nova-compute[75993]: WARNING nova.compute.manager [req-43211b23-9947-453a-b631-8e33b0ecd2f9 req-c744af90-3d65-4875-a387-64ef643ae179 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Received unexpected event network-vif-plugged-ea4bab11-7194-4967-9a1c-a3102baa9863 for instance with vm_state building and task_state spawning.
Nov 08 22:30:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:30:20 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Instance spawned successfully.
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:30:20 user nova-compute[75993]: INFO nova.compute.manager [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:30:20 user nova-compute[75993]: INFO nova.compute.manager [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Took 5.65 seconds to build instance.
Nov 08 22:30:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e01a0614-3e6f-43f8-8516-008f63e7f0b0 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.751s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-cd2bb3b0-ed1d-41e6-afce-654da7202a95 req-9859b137-10fb-4937-9603-243429181170 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Received event network-vif-plugged-ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cd2bb3b0-ed1d-41e6-afce-654da7202a95 req-9859b137-10fb-4937-9603-243429181170 service nova] Acquiring lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cd2bb3b0-ed1d-41e6-afce-654da7202a95 req-9859b137-10fb-4937-9603-243429181170 service nova] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-cd2bb3b0-ed1d-41e6-afce-654da7202a95 req-9859b137-10fb-4937-9603-243429181170 service nova] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:30:20 user nova-compute[75993]: DEBUG nova.compute.manager [req-cd2bb3b0-ed1d-41e6-afce-654da7202a95 req-9859b137-10fb-4937-9603-243429181170 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] No waiting events found dispatching network-vif-plugged-ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:30:20 user nova-compute[75993]: WARNING nova.compute.manager [req-cd2bb3b0-ed1d-41e6-afce-654da7202a95 req-9859b137-10fb-4937-9603-243429181170 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Received unexpected event network-vif-plugged-ea4bab11-7194-4967-9a1c-a3102baa9863 for instance with vm_state active and task_state None.
Nov 08 22:30:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:31 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-36a2a518-1bd8-40e9-a944-b5c57f2e6e21 req-46e9ae4e-4059-4e20-b235-5c1265fc1b06 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received event network-changed-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:30:33 user nova-compute[75993]: DEBUG nova.compute.manager [req-36a2a518-1bd8-40e9-a944-b5c57f2e6e21 req-46e9ae4e-4059-4e20-b235-5c1265fc1b06 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Refreshing instance network info cache due to event network-changed-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:30:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-36a2a518-1bd8-40e9-a944-b5c57f2e6e21 req-46e9ae4e-4059-4e20-b235-5c1265fc1b06 service nova] Acquiring lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:30:33 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-36a2a518-1bd8-40e9-a944-b5c57f2e6e21 req-46e9ae4e-4059-4e20-b235-5c1265fc1b06 service nova] Acquired lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:30:33 user nova-compute[75993]: DEBUG nova.network.neutron [req-36a2a518-1bd8-40e9-a944-b5c57f2e6e21 req-46e9ae4e-4059-4e20-b235-5c1265fc1b06 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Refreshing network info cache for port 18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:30:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-36a2a518-1bd8-40e9-a944-b5c57f2e6e21 req-46e9ae4e-4059-4e20-b235-5c1265fc1b06 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updated VIF entry in instance network info cache for port 18ea8a14-d0f5-4b66-a0fc-3c1c0b774177. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:30:34 user nova-compute[75993]: DEBUG nova.network.neutron [req-36a2a518-1bd8-40e9-a944-b5c57f2e6e21 req-46e9ae4e-4059-4e20-b235-5c1265fc1b06 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updating instance_info_cache with network_info: [{"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:30:34 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-36a2a518-1bd8-40e9-a944-b5c57f2e6e21 req-46e9ae4e-4059-4e20-b235-5c1265fc1b06 service nova] Releasing lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:30:34 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:36 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:30:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:39 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:30:39 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:30:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:30:39 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:30:39 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:30:39 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 2299c8b0-2e55-4679-bde2-a32d1119f1c4 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:30:40 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updating instance_info_cache with network_info: [{"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:30:40 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:30:40 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:30:40 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:41 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:42 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:30:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:30:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:30:42 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:30:42 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:30:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:30:42 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:30:43 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:30:43 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=24.93658447265625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 2299c8b0-2e55-4679-bde2-a32d1119f1c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 58f0933d-8a7d-4087-8cc0-12442621c20a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:30:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:30:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:30:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "1ce00047-cb04-4701-a47f-48c43627c1a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:30:53 user nova-compute[75993]: INFO nova.compute.claims [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Claim successful on node user
Nov 08 22:30:53 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG nova.network.neutron [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:30:53 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:30:53 user nova-compute[75993]: DEBUG nova.compute.manager [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG nova.policy [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4d2f038c60247b894c8849ee3b9183b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ef08c827c91436bb907130af0c4f031', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:30:53 user nova-compute[75993]: INFO nova.virt.block_device [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Booting with volume 25fc9fe5-5d01-4289-bf51-eb23634ad2a0 at /dev/vda
Nov 08 22:30:53 user nova-compute[75993]: DEBUG os_brick.utils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa30b1f-6492-49dc-ad9f-6a5f6674574f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a648468a-b125-49ff-a4b6-b6e119ebdee4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba9a135-65ec-4289-a4aa-cb82256afcc7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[116faa03-1646-4748-bcc2-a678cf6cfe57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:30:53 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:30:53 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0110bd68-724c-4f56-b04f-c7e0e20169cc]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG os_brick.utils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:30:53 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Updating existing volume attachment record: b95c9ca0-46d0-436b-8dbb-2c72f2cb0b1b {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:30:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:30:54 user nova-compute[75993]: DEBUG nova.network.neutron [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Successfully created port: 01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:30:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG nova.network.neutron [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Successfully updated port: 01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquired lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG nova.network.neutron [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG nova.compute.manager [req-5bcc608f-d6a2-4375-9231-215623e5179e req-95d51710-9a08-4aae-8cac-d8e78ce0e38e service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received event network-changed-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG nova.compute.manager [req-5bcc608f-d6a2-4375-9231-215623e5179e req-95d51710-9a08-4aae-8cac-d8e78ce0e38e service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Refreshing instance network info cache due to event network-changed-01b8ea24-ad04-4f68-aacb-33f06c3d7267. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5bcc608f-d6a2-4375-9231-215623e5179e req-95d51710-9a08-4aae-8cac-d8e78ce0e38e service nova] Acquiring lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG nova.network.neutron [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG nova.network.neutron [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Updating instance_info_cache with network_info: [{"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Releasing lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Instance network_info: |[{"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5bcc608f-d6a2-4375-9231-215623e5179e req-95d51710-9a08-4aae-8cac-d8e78ce0e38e service nova] Acquired lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:30:55 user nova-compute[75993]: DEBUG nova.network.neutron [req-5bcc608f-d6a2-4375-9231-215623e5179e req-95d51710-9a08-4aae-8cac-d8e78ce0e38e service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Refreshing network info cache for port 01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:30:56 user nova-compute[75993]: DEBUG nova.network.neutron [req-5bcc608f-d6a2-4375-9231-215623e5179e req-95d51710-9a08-4aae-8cac-d8e78ce0e38e service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Updated VIF entry in instance network info cache for port 01b8ea24-ad04-4f68-aacb-33f06c3d7267. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:30:56 user nova-compute[75993]: DEBUG nova.network.neutron [req-5bcc608f-d6a2-4375-9231-215623e5179e req-95d51710-9a08-4aae-8cac-d8e78ce0e38e service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Updating instance_info_cache with network_info: [{"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:30:56 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-5bcc608f-d6a2-4375-9231-215623e5179e req-95d51710-9a08-4aae-8cac-d8e78ce0e38e service nova] Releasing lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:30:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:30:56 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 22:30:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:04 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:31:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.compute.manager [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:31:16 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Creating image(s)
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Did not create local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Ensure instance console log exists: /opt/stack/data/nova/instances/1ce00047-cb04-4701-a47f-48c43627c1a8/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Start _get_guest_xml network_info=[{"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'attachment_id': 'b95c9ca0-46d0-436b-8dbb-2c72f2cb0b1b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxUEaquB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1ce00047-cb04-4701-a47f-48c43627c1a8', 'attached_at': '', 'detached_at': '', 'volume_id': '25fc9fe5-5d01-4289-bf51-eb23634ad2a0', 'serial': '25fc9fe5-5d01-4289-bf51-eb23634ad2a0'}, 'volume_type': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:31:16 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:31:16 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxUEaquB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:31:16 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:31:16 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:31:16 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86fbf90-3aea-4fb2-9afe-20786be3329b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:31:16 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b071508-3a5b-47c1-8bb4-676910b85611]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0] added
Nov 08 22:31:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b16604-af87-4088-875e-cf067ffccb0c]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9f402d-a49b-44cf-adc2-2b7760471ff1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxUEaquB {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxUEaquB" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[908a7a0f-c5fe-4116-a923-703b03aa17e9]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kxUEaquB'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[855cddf4-6338-40d8-ac0a-51602e269fa8]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[716223ab-0a76-426b-82d6-96a2487bca0b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:31:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:31:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dae3ca6-2fe7-4777-ae72-049be1f9bc5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0, portal: 172.16.0.220,3260]
Nov 08 22:31:16 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0, portal: 172.16.0.220,3260] successful.
Nov 08 22:31:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[444c8abc-5967-4fb4-87e0-f3333347044a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb054fe-0b50-4647-ac9c-5bb572eb9678]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:31:16 user nova-compute[75993]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)
Nov 08 22:31:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:31:16 user nova-compute[75993]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)
Nov 08 22:31:16 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[532a0ecd-0b84-41ca-82f9-9ed5e4e1aa49]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:31:16 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxUEaquB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23838393733366431', 'path': '/dev/sdc'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838393733366431', 'path': '/dev/sdc'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1754698818',display_name='tempest-TestVolumeBootPattern-server-1754698818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1754698818',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtqgsG6SU0vF+HBwuY1w6anz7HT7ETGYSZ+dcW0ZWCVczHSpVsOGu3TwvVBpDTX6Z9hhqRptung3GUpoJgwg+8wpGEqUivf7YEwSNsT7kqzGjH87a2psJQ1CWH9W+Z7w==',key_name='tempest-TestVolumeBootPattern-662113852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-zj3d0gpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:30:54Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=1ce00047-cb04-4701-a47f-48c43627c1a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b8ea24-ad04-4f68-aacb-33f06c3d7267,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b8ea24-ad') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG nova.objects.instance [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ce00047-cb04-4701-a47f-48c43627c1a8 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:31:17 user nova-compute[75993]:   <uuid>1ce00047-cb04-4701-a47f-48c43627c1a8</uuid>
Nov 08 22:31:17 user nova-compute[75993]:   <name>instance-00000033</name>
Nov 08 22:31:17 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:31:17 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:31:17 user nova-compute[75993]:   <metadata>
Nov 08 22:31:17 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:31:17 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:31:17 user nova-compute[75993]:       <nova:name>tempest-TestVolumeBootPattern-server-1754698818</nova:name>
Nov 08 22:31:17 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:31:16</nova:creationTime>
Nov 08 22:31:17 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:31:17 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:31:17 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:31:17 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:31:17 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:31:17 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:31:17 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:31:17 user nova-compute[75993]:       <nova:owner>
Nov 08 22:31:17 user nova-compute[75993]:         <nova:user uuid="e4d2f038c60247b894c8849ee3b9183b">tempest-TestVolumeBootPattern-1717039666-project-member</nova:user>
Nov 08 22:31:17 user nova-compute[75993]:         <nova:project uuid="9ef08c827c91436bb907130af0c4f031">tempest-TestVolumeBootPattern-1717039666</nova:project>
Nov 08 22:31:17 user nova-compute[75993]:       </nova:owner>
Nov 08 22:31:17 user nova-compute[75993]:       <nova:ports>
Nov 08 22:31:17 user nova-compute[75993]:         <nova:port uuid="01b8ea24-ad04-4f68-aacb-33f06c3d7267">
Nov 08 22:31:17 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 22:31:17 user nova-compute[75993]:         </nova:port>
Nov 08 22:31:17 user nova-compute[75993]:       </nova:ports>
Nov 08 22:31:17 user nova-compute[75993]:     </nova:instance>
Nov 08 22:31:17 user nova-compute[75993]:   </metadata>
Nov 08 22:31:17 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:31:17 user nova-compute[75993]:     <system>
Nov 08 22:31:17 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:31:17 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:31:17 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:31:17 user nova-compute[75993]:       <entry name="serial">1ce00047-cb04-4701-a47f-48c43627c1a8</entry>
Nov 08 22:31:17 user nova-compute[75993]:       <entry name="uuid">1ce00047-cb04-4701-a47f-48c43627c1a8</entry>
Nov 08 22:31:17 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:31:17 user nova-compute[75993]:     </system>
Nov 08 22:31:17 user nova-compute[75993]:   </sysinfo>
Nov 08 22:31:17 user nova-compute[75993]:   <os>
Nov 08 22:31:17 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:31:17 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:31:17 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:31:17 user nova-compute[75993]:   </os>
Nov 08 22:31:17 user nova-compute[75993]:   <features>
Nov 08 22:31:17 user nova-compute[75993]:     <acpi/>
Nov 08 22:31:17 user nova-compute[75993]:     <apic/>
Nov 08 22:31:17 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:31:17 user nova-compute[75993]:   </features>
Nov 08 22:31:17 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:31:17 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:31:17 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:31:17 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:31:17 user nova-compute[75993]:   </clock>
Nov 08 22:31:17 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:31:17 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:31:17 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:31:17 user nova-compute[75993]:   </cpu>
Nov 08 22:31:17 user nova-compute[75993]:   <devices>
Nov 08 22:31:17 user nova-compute[75993]:     <disk type="block" device="disk">
Nov 08 22:31:17 user nova-compute[75993]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:31:17 user nova-compute[75993]:       <source dev="/dev/sdc"/>
Nov 08 22:31:17 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:31:17 user nova-compute[75993]:       <serial>25fc9fe5-5d01-4289-bf51-eb23634ad2a0</serial>
Nov 08 22:31:17 user nova-compute[75993]:     </disk>
Nov 08 22:31:17 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:31:17 user nova-compute[75993]:       <mac address="fa:16:3e:96:79:fe"/>
Nov 08 22:31:17 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:31:17 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:31:17 user nova-compute[75993]:       <target dev="tap01b8ea24-ad"/>
Nov 08 22:31:17 user nova-compute[75993]:     </interface>
Nov 08 22:31:17 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:31:17 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/1ce00047-cb04-4701-a47f-48c43627c1a8/console.log" append="off"/>
Nov 08 22:31:17 user nova-compute[75993]:     </serial>
Nov 08 22:31:17 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:31:17 user nova-compute[75993]:     <video>
Nov 08 22:31:17 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:31:17 user nova-compute[75993]:     </video>
Nov 08 22:31:17 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:31:17 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:31:17 user nova-compute[75993]:     </rng>
Nov 08 22:31:17 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:31:17 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:31:17 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:31:17 user nova-compute[75993]:     </memballoon>
Nov 08 22:31:17 user nova-compute[75993]:   </devices>
Nov 08 22:31:17 user nova-compute[75993]: </domain>
Nov 08 22:31:17 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1754698818',display_name='tempest-TestVolumeBootPattern-server-1754698818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1754698818',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtqgsG6SU0vF+HBwuY1w6anz7HT7ETGYSZ+dcW0ZWCVczHSpVsOGu3TwvVBpDTX6Z9hhqRptung3GUpoJgwg+8wpGEqUivf7YEwSNsT7kqzGjH87a2psJQ1CWH9W+Z7w==',key_name='tempest-TestVolumeBootPattern-662113852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-zj3d0gpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:30:54Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=1ce00047-cb04-4701-a47f-48c43627c1a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b8ea24-ad04-4f68-aacb-33f06c3d7267,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b8ea24-ad') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG os_vif [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b8ea24-ad04-4f68-aacb-33f06c3d7267,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b8ea24-ad') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec4b61e4-073c-5065-a64b-9934ce1a8781', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01b8ea24-ad, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01b8ea24-ad, col_values=(('qos', UUID('5017be0d-87e9-4dbd-992c-b363a2b8b80b')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01b8ea24-ad, col_values=(('external_ids', {'iface-id': '01b8ea24-ad04-4f68-aacb-33f06c3d7267', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:79:fe', 'vm-uuid': '1ce00047-cb04-4701-a47f-48c43627c1a8'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:31:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:17 user nova-compute[75993]: INFO os_vif [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b8ea24-ad04-4f68-aacb-33f06c3d7267,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b8ea24-ad')
Nov 08 22:31:18 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:31:18 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] No VIF found with MAC fa:16:3e:96:79:fe, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:31:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-316497d6-6fb7-4e2a-915b-959015f8877e req-5f756ed9-5481-49d6-a437-724ae31b115f service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received event network-vif-plugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:31:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-316497d6-6fb7-4e2a-915b-959015f8877e req-5f756ed9-5481-49d6-a437-724ae31b115f service nova] Acquiring lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:31:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-316497d6-6fb7-4e2a-915b-959015f8877e req-5f756ed9-5481-49d6-a437-724ae31b115f service nova] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:31:19 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-316497d6-6fb7-4e2a-915b-959015f8877e req-5f756ed9-5481-49d6-a437-724ae31b115f service nova] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:31:19 user nova-compute[75993]: DEBUG nova.compute.manager [req-316497d6-6fb7-4e2a-915b-959015f8877e req-5f756ed9-5481-49d6-a437-724ae31b115f service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] No waiting events found dispatching network-vif-plugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:31:19 user nova-compute[75993]: WARNING nova.compute.manager [req-316497d6-6fb7-4e2a-915b-959015f8877e req-5f756ed9-5481-49d6-a437-724ae31b115f service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received unexpected event network-vif-plugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 for instance with vm_state building and task_state spawning.
Nov 08 22:31:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.compute.manager [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:31:21 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Instance spawned successfully.
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:31:21 user nova-compute[75993]: INFO nova.compute.manager [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.compute.manager [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:31:21 user nova-compute[75993]: INFO nova.compute.manager [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Took 28.27 seconds to build instance.
Nov 08 22:31:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-10570ff2-2d39-4790-a5c0-a58327fd5611 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.367s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.compute.manager [req-4f9772ba-50bb-48af-9a98-2476c9fdea06 req-49146b64-6584-48e0-b5de-e5cce62a9489 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received event network-vif-plugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4f9772ba-50bb-48af-9a98-2476c9fdea06 req-49146b64-6584-48e0-b5de-e5cce62a9489 service nova] Acquiring lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4f9772ba-50bb-48af-9a98-2476c9fdea06 req-49146b64-6584-48e0-b5de-e5cce62a9489 service nova] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4f9772ba-50bb-48af-9a98-2476c9fdea06 req-49146b64-6584-48e0-b5de-e5cce62a9489 service nova] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:31:21 user nova-compute[75993]: DEBUG nova.compute.manager [req-4f9772ba-50bb-48af-9a98-2476c9fdea06 req-49146b64-6584-48e0-b5de-e5cce62a9489 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] No waiting events found dispatching network-vif-plugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:31:21 user nova-compute[75993]: WARNING nova.compute.manager [req-4f9772ba-50bb-48af-9a98-2476c9fdea06 req-49146b64-6584-48e0-b5de-e5cce62a9489 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received unexpected event network-vif-plugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 for instance with vm_state active and task_state None.
Nov 08 22:31:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:31:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:31:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:31:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:31:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:31:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 2299c8b0-2e55-4679-bde2-a32d1119f1c4 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 58f0933d-8a7d-4087-8cc0-12442621c20a {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Triggering sync for uuid 1ce00047-cb04-4701-a47f-48c43627c1a8 {{(pid=75993) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "58f0933d-8a7d-4087-8cc0-12442621c20a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "1ce00047-cb04-4701-a47f-48c43627c1a8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:31:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:31:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:31:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:31:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:31:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:31:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:31:42 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Updating instance_info_cache with network_info: [{"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:31:42 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:31:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:31:42 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:31:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:31:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:31:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:31:43 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:31:43 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:31:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:31:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:31:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:31:44 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:31:44 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:31:44 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=24.93335723876953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 2299c8b0-2e55-4679-bde2-a32d1119f1c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 58f0933d-8a7d-4087-8cc0-12442621c20a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1ce00047-cb04-4701-a47f-48c43627c1a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:31:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:31:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:31:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:31:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:31:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:31:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:31:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:31:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:31:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:31:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:31:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:31:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:31:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:31:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:32:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-4fea3ffe-23c6-4ef6-bd73-3b4b1a96886c req-f05b73d7-0b40-472b-a6e9-f2371eda7ca9 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Received event network-changed-ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:32:05 user nova-compute[75993]: DEBUG nova.compute.manager [req-4fea3ffe-23c6-4ef6-bd73-3b4b1a96886c req-f05b73d7-0b40-472b-a6e9-f2371eda7ca9 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Refreshing instance network info cache due to event network-changed-ea4bab11-7194-4967-9a1c-a3102baa9863. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:32:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4fea3ffe-23c6-4ef6-bd73-3b4b1a96886c req-f05b73d7-0b40-472b-a6e9-f2371eda7ca9 service nova] Acquiring lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:32:05 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4fea3ffe-23c6-4ef6-bd73-3b4b1a96886c req-f05b73d7-0b40-472b-a6e9-f2371eda7ca9 service nova] Acquired lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:32:05 user nova-compute[75993]: DEBUG nova.network.neutron [req-4fea3ffe-23c6-4ef6-bd73-3b4b1a96886c req-f05b73d7-0b40-472b-a6e9-f2371eda7ca9 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Refreshing network info cache for port ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:32:06 user nova-compute[75993]: DEBUG nova.network.neutron [req-4fea3ffe-23c6-4ef6-bd73-3b4b1a96886c req-f05b73d7-0b40-472b-a6e9-f2371eda7ca9 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Updated VIF entry in instance network info cache for port ea4bab11-7194-4967-9a1c-a3102baa9863. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:32:06 user nova-compute[75993]: DEBUG nova.network.neutron [req-4fea3ffe-23c6-4ef6-bd73-3b4b1a96886c req-f05b73d7-0b40-472b-a6e9-f2371eda7ca9 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Updating instance_info_cache with network_info: [{"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:32:06 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4fea3ffe-23c6-4ef6-bd73-3b4b1a96886c req-f05b73d7-0b40-472b-a6e9-f2371eda7ca9 service nova] Releasing lock "refresh_cache-58f0933d-8a7d-4087-8cc0-12442621c20a" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:32:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "58f0933d-8a7d-4087-8cc0-12442621c20a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'flavor' on Instance uuid 58f0933d-8a7d-4087-8cc0-12442621c20a {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "58f0933d-8a7d-4087-8cc0-12442621c20a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:32:11 user nova-compute[75993]: INFO nova.compute.manager [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Attaching volume d8098d9c-39ba-43e0-a434-8208a6ca60da to /dev/vdb
Nov 08 22:32:11 user nova-compute[75993]: DEBUG os_brick.utils [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a56ae90-2206-4b4b-9ea8-8bde93058353]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f33f9be-8655-487b-93cf-52d8d3dda908]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d975010d-7e04-4dbf-89b9-8e9627c26ec5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ce4e97-bcd9-4e2f-98d2-21c7817807f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:32:11 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:32:11 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2dedaf-a4e7-4f91-a4a5-7979396d2af5]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG os_brick.utils [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:32:11 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Updating existing volume attachment record: 3432ce9e-d58a-494e-bd33-7f4b4cbff475 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:32:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:32:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:32:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:32:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:32:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPqHocrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:32:34 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:32:34 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:32:34 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d15422-3197-4d1c-b7f8-ad09aaa20d1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:32:34 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6ce28d-81de-48e2-af0f-9a0c6d3cb0a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da] added
Nov 08 22:32:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[88161cec-0955-4148-9705-6c8dce87c179]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdd53a7-2710-4c0c-ac7e-bdb176b47c8a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPqHocrO {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DPqHocrO" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fba81f6-aca8-4e7e-b1ed-9b34bb560ce6]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DPqHocrO'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78aaa9b-d814-43ac-a5d0-4b6a71a05fea]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df043d3-5b1e-47e5-93c4-57648868c51a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:32:34 user nova-compute[75993]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)
Nov 08 22:32:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:32:34 user nova-compute[75993]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)
Nov 08 22:32:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a35535a-9d1e-4446-a951-ac864974bd94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da, portal: 172.16.0.220,3260]
Nov 08 22:32:34 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da, portal: 172.16.0.220,3260] successful.
Nov 08 22:32:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[305a34a5-7253-4fa6-b3ec-9b4990e30050]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21a967f-cbb5-4f1d-84b2-d0e6ff29a78d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:32:34 user nova-compute[75993]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)
Nov 08 22:32:34 user nova-compute[75993]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da (non-flash)
Nov 08 22:32:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:32:34 user nova-compute[75993]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)
Nov 08 22:32:34 user nova-compute[75993]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da (non-flash)
Nov 08 22:32:34 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] HCTL ('35', '-', '-', 0) found on session 59 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18924af-ce4b-4638-890b-a35e7494a526]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:32:34 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPqHocrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:32:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:32:35 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23636383662343066', 'path': '/dev/sdd'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:32:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23636383662343066', 'path': '/dev/sdd'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:32:35 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'flavor' on Instance uuid 58f0933d-8a7d-4087-8cc0-12442621c20a {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:32:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 22:32:35 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:32:35 user nova-compute[75993]:   <source dev="/dev/sdd"/>
Nov 08 22:32:35 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:32:35 user nova-compute[75993]:   <serial>d8098d9c-39ba-43e0-a434-8208a6ca60da</serial>
Nov 08 22:32:35 user nova-compute[75993]: </disk>
Nov 08 22:32:35 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 22:32:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:32:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:32:35 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] No VIF found with MAC fa:16:3e:0e:35:cd, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:32:35 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a175ec44-6545-4b8e-90ea-45966d97d5be tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.491s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:32:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "58f0933d-8a7d-4087-8cc0-12442621c20a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:32:36 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:32:36 user nova-compute[75993]: INFO nova.compute.manager [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Detaching volume d8098d9c-39ba-43e0-a434-8208a6ca60da
Nov 08 22:32:36 user nova-compute[75993]: INFO nova.virt.block_device [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Attempting to driver detach volume d8098d9c-39ba-43e0-a434-8208a6ca60da from mountpoint /dev/vdb
Nov 08 22:32:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Attempting to detach device vdb from instance 58f0933d-8a7d-4087-8cc0-12442621c20a from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 22:32:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:32:36 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:32:36 user nova-compute[75993]:   <source dev="/dev/sdd"/>
Nov 08 22:32:36 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:32:36 user nova-compute[75993]:   <serial>d8098d9c-39ba-43e0-a434-8208a6ca60da</serial>
Nov 08 22:32:36 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:32:36 user nova-compute[75993]: </disk>
Nov 08 22:32:36 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:32:36 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully detached device vdb from instance 58f0933d-8a7d-4087-8cc0-12442621c20a from the persistent domain config.
Nov 08 22:32:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 58f0933d-8a7d-4087-8cc0-12442621c20a from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 22:32:36 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:32:36 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:32:36 user nova-compute[75993]:   <source dev="/dev/sdd"/>
Nov 08 22:32:36 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:32:36 user nova-compute[75993]:   <serial>d8098d9c-39ba-43e0-a434-8208a6ca60da</serial>
Nov 08 22:32:36 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:32:36 user nova-compute[75993]: </disk>
Nov 08 22:32:36 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:32:37 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 58f0933d-8a7d-4087-8cc0-12442621c20a {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 22:32:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:38 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:32:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:32:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:32:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:32:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:32:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:32:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:32:41 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 2299c8b0-2e55-4679-bde2-a32d1119f1c4 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:32:41 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updating instance_info_cache with network_info: [{"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:32:41 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:32:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:32:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:32:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:32:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:32:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:32:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:43 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:32:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:32:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-4d26ad80-dd93-4c18-b40f-8a2e87ebd0ec req-b854549c-079f-4fe5-8f24-a0cb319dca98 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received event network-changed-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:32:44 user nova-compute[75993]: DEBUG nova.compute.manager [req-4d26ad80-dd93-4c18-b40f-8a2e87ebd0ec req-b854549c-079f-4fe5-8f24-a0cb319dca98 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Refreshing instance network info cache due to event network-changed-01b8ea24-ad04-4f68-aacb-33f06c3d7267. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:32:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4d26ad80-dd93-4c18-b40f-8a2e87ebd0ec req-b854549c-079f-4fe5-8f24-a0cb319dca98 service nova] Acquiring lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:32:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4d26ad80-dd93-4c18-b40f-8a2e87ebd0ec req-b854549c-079f-4fe5-8f24-a0cb319dca98 service nova] Acquired lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:32:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-4d26ad80-dd93-4c18-b40f-8a2e87ebd0ec req-b854549c-079f-4fe5-8f24-a0cb319dca98 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Refreshing network info cache for port 01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:32:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-4d26ad80-dd93-4c18-b40f-8a2e87ebd0ec req-b854549c-079f-4fe5-8f24-a0cb319dca98 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Updated VIF entry in instance network info cache for port 01b8ea24-ad04-4f68-aacb-33f06c3d7267. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:32:44 user nova-compute[75993]: DEBUG nova.network.neutron [req-4d26ad80-dd93-4c18-b40f-8a2e87ebd0ec req-b854549c-079f-4fe5-8f24-a0cb319dca98 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Updating instance_info_cache with network_info: [{"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:32:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-4d26ad80-dd93-4c18-b40f-8a2e87ebd0ec req-b854549c-079f-4fe5-8f24-a0cb319dca98 service nova] Releasing lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-0d6fc8da-5c4a-46d8-ad60-6dc36d971b6c req-a42d6518-11c5-4815-989f-237977592dfe service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received event network-changed-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG nova.compute.manager [req-0d6fc8da-5c4a-46d8-ad60-6dc36d971b6c req-a42d6518-11c5-4815-989f-237977592dfe service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Refreshing instance network info cache due to event network-changed-01b8ea24-ad04-4f68-aacb-33f06c3d7267. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0d6fc8da-5c4a-46d8-ad60-6dc36d971b6c req-a42d6518-11c5-4815-989f-237977592dfe service nova] Acquiring lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0d6fc8da-5c4a-46d8-ad60-6dc36d971b6c req-a42d6518-11c5-4815-989f-237977592dfe service nova] Acquired lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG nova.network.neutron [req-0d6fc8da-5c4a-46d8-ad60-6dc36d971b6c req-a42d6518-11c5-4815-989f-237977592dfe service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Refreshing network info cache for port 01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "1ce00047-cb04-4701-a47f-48c43627c1a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:32:45 user nova-compute[75993]: INFO nova.compute.manager [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Terminating instance
Nov 08 22:32:45 user nova-compute[75993]: DEBUG nova.compute.manager [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:45 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:46 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Instance destroyed successfully.
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'resources' on Instance uuid 1ce00047-cb04-4701-a47f-48c43627c1a8 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:30:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1754698818',display_name='tempest-TestVolumeBootPattern-server-1754698818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1754698818',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtqgsG6SU0vF+HBwuY1w6anz7HT7ETGYSZ+dcW0ZWCVczHSpVsOGu3TwvVBpDTX6Z9hhqRptung3GUpoJgwg+8wpGEqUivf7YEwSNsT7kqzGjH87a2psJQ1CWH9W+Z7w==',key_name='tempest-TestVolumeBootPattern-662113852',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:31:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-zj3d0gpw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:31:22Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=1ce00047-cb04-4701-a47f-48c43627c1a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b8ea24-ad04-4f68-aacb-33f06c3d7267,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b8ea24-ad') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_vif [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b8ea24-ad04-4f68-aacb-33f06c3d7267,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b8ea24-ad') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01b8ea24-ad, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.network.neutron [req-0d6fc8da-5c4a-46d8-ad60-6dc36d971b6c req-a42d6518-11c5-4815-989f-237977592dfe service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Updated VIF entry in instance network info cache for port 01b8ea24-ad04-4f68-aacb-33f06c3d7267. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.network.neutron [req-0d6fc8da-5c4a-46d8-ad60-6dc36d971b6c req-a42d6518-11c5-4815-989f-237977592dfe service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Updating instance_info_cache with network_info: [{"id": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "address": "fa:16:3e:96:79:fe", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01b8ea24-ad", "ovs_interfaceid": "01b8ea24-ad04-4f68-aacb-33f06c3d7267", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5017be0d-87e9-4dbd-992c-b363a2b8b80b) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:32:46 user nova-compute[75993]: INFO os_vif [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:79:fe,bridge_name='br-int',has_traffic_filtering=True,id=01b8ea24-ad04-4f68-aacb-33f06c3d7267,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01b8ea24-ad')
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxUEaquB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:32:46 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0d6fc8da-5c4a-46d8-ad60-6dc36d971b6c req-a42d6518-11c5-4815-989f-237977592dfe service nova] Releasing lock "refresh_cache-1ce00047-cb04-4701-a47f-48c43627c1a8" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[da116c95-2cb0-4ea4-96b0-86e1ff3a49ef]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:32:46 user nova-compute[75993]: No targets found.
Nov 08 22:32:46 user nova-compute[75993]: iSNS:
Nov 08 22:32:46 user nova-compute[75993]: No targets found.
Nov 08 22:32:46 user nova-compute[75993]: STATIC:
Nov 08 22:32:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0
Nov 08 22:32:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:32:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:32:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036
Nov 08 22:32:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:32:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:32:46 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da
Nov 08 22:32:46 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:32:46 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:32:46 user nova-compute[75993]: FIRMWARE:
Nov 08 22:32:46 user nova-compute[75993]: No targets found.
Nov 08 22:32:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:32:46 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:32:46 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[59332f37-c7aa-443e-8a4f-0cf0a1cbdb84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bcc4ac-0a59-44f5-9900-1a137d737864]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:32:46 user nova-compute[75993]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)
Nov 08 22:32:46 user nova-compute[75993]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da (non-flash)
Nov 08 22:32:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:32:46 user nova-compute[75993]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 (non-flash)
Nov 08 22:32:46 user nova-compute[75993]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da (non-flash)
Nov 08 22:32:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f85881e49d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0'): ({'sdc'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Removing single pathed devices sdc {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde4a969-7177-482e-8354-49f76d7add19]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2525fc46-8ec3-401a-a3e1-eb296265f3af]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flushing IO for device /dev/sdc {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e720baf3-77ff-46f1-a398-ea10f70a3c90]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c57a4f-f833-461c-901b-6ceddf08ba69]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] SCSI volumes sdc have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received event network-vif-unplugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] Acquiring lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] No waiting events found dispatching network-vif-unplugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received event network-vif-unplugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received event network-vif-plugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] Acquiring lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.compute.manager [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] No waiting events found dispatching network-vif-plugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:32:46 user nova-compute[75993]: WARNING nova.compute.manager [req-2ea4f57d-3795-486a-b6a7-7a007335609e req-8cf5afe6-145f-41dd-91f9-203b5b47fad5 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received unexpected event network-vif-plugged-01b8ea24-ad04-4f68-aacb-33f06c3d7267 for instance with vm_state active and task_state deleting.
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[162d126c-83e8-4a4a-aa71-2251ef4cccb4]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f2d115-8cac-4983-aec9-5448bfa09efd]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0, portal: 172.16.0.220,3260]
Nov 08 22:32:46 user nova-compute[75993]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0, portal: 172.16.0.220,3260] successful.
Nov 08 22:32:46 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25fc9fe5-5d01-4289-bf51-eb23634ad2a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4260ce4f-c01c-4539-8505-ef5339cf28ea]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.415s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== disconnect_volume: return (416ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:32:46 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Deleting instance files /opt/stack/data/nova/instances/1ce00047-cb04-4701-a47f-48c43627c1a8_del
Nov 08 22:32:46 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Deletion of /opt/stack/data/nova/instances/1ce00047-cb04-4701-a47f-48c43627c1a8_del complete
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:32:46 user nova-compute[75993]: INFO nova.compute.manager [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 08 22:32:46 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:32:46 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:32:47 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:32:47 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=24.93191909790039GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 2299c8b0-2e55-4679-bde2-a32d1119f1c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 58f0933d-8a7d-4087-8cc0-12442621c20a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 1ce00047-cb04-4701-a47f-48c43627c1a8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:32:47 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:32:47 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Took 0.66 seconds to deallocate network for instance.
Nov 08 22:32:48 user nova-compute[75993]: INFO nova.compute.manager [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Took 1.08 seconds to detach 1 volumes for instance.
Nov 08 22:32:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:32:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:32:48 user nova-compute[75993]: DEBUG nova.compute.manager [req-f90a618c-454a-4fed-ada8-a31f65084140 req-10ee3f70-821d-41ac-b85c-31b6c4032ce2 service nova] [instance: 1ce00047-cb04-4701-a47f-48c43627c1a8] Received event network-vif-deleted-01b8ea24-ad04-4f68-aacb-33f06c3d7267 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:32:48 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:32:48 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:32:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:32:48 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Deleted allocations for instance 1ce00047-cb04-4701-a47f-48c43627c1a8
Nov 08 22:32:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-246310e5-d89d-4563-9436-ca56cb1edbca tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "1ce00047-cb04-4701-a47f-48c43627c1a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.385s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:32:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:32:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:32:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:32:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:32:51 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:32:56 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:32:57 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 58f0933d-8a7d-4087-8cc0-12442621c20a is timed out.
Nov 08 22:32:57 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully detached device vdb from instance 58f0933d-8a7d-4087-8cc0-12442621c20a from the live domain config.
Nov 08 22:32:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DPqHocrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:32:57 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a1e42b-7e2a-4864-a02b-d2056ffd9898]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:32:57 user nova-compute[75993]: No targets found.
Nov 08 22:32:57 user nova-compute[75993]: iSNS:
Nov 08 22:32:57 user nova-compute[75993]: No targets found.
Nov 08 22:32:57 user nova-compute[75993]: STATIC:
Nov 08 22:32:57 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036
Nov 08 22:32:57 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:32:57 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:32:57 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da
Nov 08 22:32:57 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:32:57 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:32:57 user nova-compute[75993]: FIRMWARE:
Nov 08 22:32:57 user nova-compute[75993]: No targets found.
Nov 08 22:32:57 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:32:57 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:32:57 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[59013aa6-b580-478c-8a0c-e99eddfba6dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2a8666-32e6-4242-9aa9-228b7e4139b0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:32:57 user nova-compute[75993]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da (non-flash)
Nov 08 22:32:57 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:32:57 user nova-compute[75993]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da (non-flash)
Nov 08 22:32:57 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544b5c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da'): ({'sdd'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Removing single pathed devices sdd {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a9b9cc-10c0-4a1d-b2be-ffbd87857dda]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a43d1c2-4fee-4350-9982-27056af4005c]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Flushing IO for device /dev/sdd {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b67537e-8dc1-4e85-92e3-60a732a86f1b]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e445f7a4-df73-450e-bdf7-e6324db3ab54]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] SCSI volumes sdd have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad6ccd8-defc-47b7-88f5-686e661b8c79]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[2922eacd-5079-4e1a-b1f8-4cb8ad4790b1]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da, portal: 172.16.0.220,3260]
Nov 08 22:32:57 user nova-compute[75993]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da, portal: 172.16.0.220,3260] successful.
Nov 08 22:32:57 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8098d9c-39ba-43e0-a434-8208a6ca60da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f88a13-a86c-4bf9-8d2f-f5dee24db631]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] <== disconnect_volume: return (298ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:32:57 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:32:58 user nova-compute[75993]: DEBUG nova.objects.instance [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'flavor' on Instance uuid 58f0933d-8a7d-4087-8cc0-12442621c20a {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:32:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-19e09354-c4af-47c6-aa25-62bd1d52a4d3 tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.775s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:33:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:09 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:33:11 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:33:16 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:21 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "58f0933d-8a7d-4087-8cc0-12442621c20a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:33:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:33:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:33:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:33:26 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:33:26 user nova-compute[75993]: INFO nova.compute.manager [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Terminating instance
Nov 08 22:33:26 user nova-compute[75993]: DEBUG nova.compute.manager [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:33:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:26 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-f660fcd2-08da-4f58-9404-f370a019871c req-1b09efd7-e228-4748-a989-9db81d4bfa69 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Received event network-vif-unplugged-ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f660fcd2-08da-4f58-9404-f370a019871c req-1b09efd7-e228-4748-a989-9db81d4bfa69 service nova] Acquiring lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f660fcd2-08da-4f58-9404-f370a019871c req-1b09efd7-e228-4748-a989-9db81d4bfa69 service nova] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-f660fcd2-08da-4f58-9404-f370a019871c req-1b09efd7-e228-4748-a989-9db81d4bfa69 service nova] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-f660fcd2-08da-4f58-9404-f370a019871c req-1b09efd7-e228-4748-a989-9db81d4bfa69 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] No waiting events found dispatching network-vif-unplugged-ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG nova.compute.manager [req-f660fcd2-08da-4f58-9404-f370a019871c req-1b09efd7-e228-4748-a989-9db81d4bfa69 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Received event network-vif-unplugged-ea4bab11-7194-4967-9a1c-a3102baa9863 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:33:27 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Instance destroyed successfully.
Nov 08 22:33:27 user nova-compute[75993]: DEBUG nova.objects.instance [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lazy-loading 'resources' on Instance uuid 58f0933d-8a7d-4087-8cc0-12442621c20a {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:30:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1544597007',display_name='tempest-AttachVolumeNegativeTest-server-1544597007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1544597007',id=50,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdz/MPmmMvYb0oRmWKOOpaki1bZ9N8AyhZzvmQIKCsUWINmPgsjPyA/XYCGBkcjr343l9Cd/2WyqYuLeugKm660PNF4tDlkMM1xMefalynuFrzEYEwKFt7tjJO8NJLG+A==',key_name='tempest-keypair-669145117',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:30:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8260793f85b4fa7a83c779f7f6c58e3',ramdisk_id='',reservation_id='r-ei3m7z7z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1149565506',owner_user_name='tempest-AttachVolumeNegativeTest-1149565506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:30:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be86d9fb78614dbeaaf9faa42bbf2868',uuid=58f0933d-8a7d-4087-8cc0-12442621c20a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converting VIF {"id": "ea4bab11-7194-4967-9a1c-a3102baa9863", "address": "fa:16:3e:0e:35:cd", "network": {"id": "3015b09d-e1ec-4dd9-aa86-b2aef374a4f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1286707684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8260793f85b4fa7a83c779f7f6c58e3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapea4bab11-71", "ovs_interfaceid": "ea4bab11-7194-4967-9a1c-a3102baa9863", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:35:cd,bridge_name='br-int',has_traffic_filtering=True,id=ea4bab11-7194-4967-9a1c-a3102baa9863,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4bab11-71') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG os_vif [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:35:cd,bridge_name='br-int',has_traffic_filtering=True,id=ea4bab11-7194-4967-9a1c-a3102baa9863,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4bab11-71') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapea4bab11-71, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=085f62f1-159e-476f-bc69-2916ac5cbed0) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:33:27 user nova-compute[75993]: INFO os_vif [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:35:cd,bridge_name='br-int',has_traffic_filtering=True,id=ea4bab11-7194-4967-9a1c-a3102baa9863,network=Network(3015b09d-e1ec-4dd9-aa86-b2aef374a4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapea4bab11-71')
Nov 08 22:33:27 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Deleting instance files /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a_del
Nov 08 22:33:27 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Deletion of /opt/stack/data/nova/instances/58f0933d-8a7d-4087-8cc0-12442621c20a_del complete
Nov 08 22:33:28 user nova-compute[75993]: INFO nova.compute.manager [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 08 22:33:28 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:33:28 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:33:28 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:33:28 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:33:28 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Took 0.60 seconds to deallocate network for instance.
Nov 08 22:33:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-f1ff3c6a-7d6a-4881-9fa2-d4d5835bc421 req-b367a4a0-1ddd-47df-910a-a8986999fb90 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Received event network-vif-deleted-ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:33:28 user nova-compute[75993]: INFO nova.compute.manager [req-f1ff3c6a-7d6a-4881-9fa2-d4d5835bc421 req-b367a4a0-1ddd-47df-910a-a8986999fb90 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Neutron deleted interface ea4bab11-7194-4967-9a1c-a3102baa9863; detaching it from the instance and deleting it from the info cache
Nov 08 22:33:28 user nova-compute[75993]: DEBUG nova.network.neutron [req-f1ff3c6a-7d6a-4881-9fa2-d4d5835bc421 req-b367a4a0-1ddd-47df-910a-a8986999fb90 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:33:28 user nova-compute[75993]: DEBUG nova.compute.manager [req-f1ff3c6a-7d6a-4881-9fa2-d4d5835bc421 req-b367a4a0-1ddd-47df-910a-a8986999fb90 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Detach interface failed, port_id=ea4bab11-7194-4967-9a1c-a3102baa9863, reason: Instance 58f0933d-8a7d-4087-8cc0-12442621c20a could not be found. {{(pid=75993) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 08 22:33:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:33:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:33:28 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:33:28 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:33:28 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:33:28 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Deleted allocations for instance 58f0933d-8a7d-4087-8cc0-12442621c20a
Nov 08 22:33:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-191f5130-19c0-4274-b4f4-3ecc0344108e tempest-AttachVolumeNegativeTest-1149565506 tempest-AttachVolumeNegativeTest-1149565506-project-member] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:33:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-57847f01-2f4e-4041-acfa-5757e1b5765d req-bac9d429-f10e-4f5b-8b6d-71049c7bdc34 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Received event network-vif-plugged-ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:33:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57847f01-2f4e-4041-acfa-5757e1b5765d req-bac9d429-f10e-4f5b-8b6d-71049c7bdc34 service nova] Acquiring lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:33:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57847f01-2f4e-4041-acfa-5757e1b5765d req-bac9d429-f10e-4f5b-8b6d-71049c7bdc34 service nova] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:33:29 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-57847f01-2f4e-4041-acfa-5757e1b5765d req-bac9d429-f10e-4f5b-8b6d-71049c7bdc34 service nova] Lock "58f0933d-8a7d-4087-8cc0-12442621c20a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:33:29 user nova-compute[75993]: DEBUG nova.compute.manager [req-57847f01-2f4e-4041-acfa-5757e1b5765d req-bac9d429-f10e-4f5b-8b6d-71049c7bdc34 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] No waiting events found dispatching network-vif-plugged-ea4bab11-7194-4967-9a1c-a3102baa9863 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:33:29 user nova-compute[75993]: WARNING nova.compute.manager [req-57847f01-2f4e-4041-acfa-5757e1b5765d req-bac9d429-f10e-4f5b-8b6d-71049c7bdc34 service nova] [instance: 58f0933d-8a7d-4087-8cc0-12442621c20a] Received unexpected event network-vif-plugged-ea4bab11-7194-4967-9a1c-a3102baa9863 for instance with vm_state deleted and task_state None.
Nov 08 22:33:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:33:39 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:33:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:33:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:33:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:33:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:33:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:33:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:33:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:33:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:33:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:33:46 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:33:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75993) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 08 22:33:46 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:33:46 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:33:46 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8909MB free_disk=24.95883560180664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:33:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:33:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:33:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 2299c8b0-2e55-4679-bde2-a32d1119f1c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:33:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:33:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:33:47 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:33:47 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:33:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:33:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:33:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:33:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:33:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:33:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:33:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:33:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:33:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:33:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:33:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:53 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:33:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-101689bd-0ce8-4f51-b09c-151ec6a4ed38 req-e3239c76-63e5-4995-b2e0-6d3d74e0ecad service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received event network-changed-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:33:58 user nova-compute[75993]: DEBUG nova.compute.manager [req-101689bd-0ce8-4f51-b09c-151ec6a4ed38 req-e3239c76-63e5-4995-b2e0-6d3d74e0ecad service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Refreshing instance network info cache due to event network-changed-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:33:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-101689bd-0ce8-4f51-b09c-151ec6a4ed38 req-e3239c76-63e5-4995-b2e0-6d3d74e0ecad service nova] Acquiring lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:33:58 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-101689bd-0ce8-4f51-b09c-151ec6a4ed38 req-e3239c76-63e5-4995-b2e0-6d3d74e0ecad service nova] Acquired lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:33:58 user nova-compute[75993]: DEBUG nova.network.neutron [req-101689bd-0ce8-4f51-b09c-151ec6a4ed38 req-e3239c76-63e5-4995-b2e0-6d3d74e0ecad service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Refreshing network info cache for port 18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:33:59 user nova-compute[75993]: INFO nova.compute.manager [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Terminating instance
Nov 08 22:33:59 user nova-compute[75993]: DEBUG nova.compute.manager [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-1d162127-c669-400b-9b9c-9ca0e554c5fb req-f6a007be-28b1-4132-bc54-9c87689ec47d service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received event network-vif-unplugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1d162127-c669-400b-9b9c-9ca0e554c5fb req-f6a007be-28b1-4132-bc54-9c87689ec47d service nova] Acquiring lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1d162127-c669-400b-9b9c-9ca0e554c5fb req-f6a007be-28b1-4132-bc54-9c87689ec47d service nova] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-1d162127-c669-400b-9b9c-9ca0e554c5fb req-f6a007be-28b1-4132-bc54-9c87689ec47d service nova] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-1d162127-c669-400b-9b9c-9ca0e554c5fb req-f6a007be-28b1-4132-bc54-9c87689ec47d service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] No waiting events found dispatching network-vif-unplugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG nova.compute.manager [req-1d162127-c669-400b-9b9c-9ca0e554c5fb req-f6a007be-28b1-4132-bc54-9c87689ec47d service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received event network-vif-unplugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG nova.network.neutron [req-101689bd-0ce8-4f51-b09c-151ec6a4ed38 req-e3239c76-63e5-4995-b2e0-6d3d74e0ecad service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updated VIF entry in instance network info cache for port 18ea8a14-d0f5-4b66-a0fc-3c1c0b774177. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG nova.network.neutron [req-101689bd-0ce8-4f51-b09c-151ec6a4ed38 req-e3239c76-63e5-4995-b2e0-6d3d74e0ecad service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updating instance_info_cache with network_info: [{"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-101689bd-0ce8-4f51-b09c-151ec6a4ed38 req-e3239c76-63e5-4995-b2e0-6d3d74e0ecad service nova] Releasing lock "refresh_cache-2299c8b0-2e55-4679-bde2-a32d1119f1c4" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Instance destroyed successfully.
Nov 08 22:33:59 user nova-compute[75993]: DEBUG nova.objects.instance [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lazy-loading 'resources' on Instance uuid 2299c8b0-2e55-4679-bde2-a32d1119f1c4 {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:28:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-526388677',display_name='tempest-TestVolumeBootPattern-server-526388677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-526388677',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTtqgsG6SU0vF+HBwuY1w6anz7HT7ETGYSZ+dcW0ZWCVczHSpVsOGu3TwvVBpDTX6Z9hhqRptung3GUpoJgwg+8wpGEqUivf7YEwSNsT7kqzGjH87a2psJQ1CWH9W+Z7w==',key_name='tempest-TestVolumeBootPattern-662113852',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:29:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ef08c827c91436bb907130af0c4f031',ramdisk_id='',reservation_id='r-y2d5qn00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1717039666',owner_user_name='tempest-TestVolumeBootPattern-1717039666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:29:11Z,user_data=None,user_id='e4d2f038c60247b894c8849ee3b9183b',uuid=2299c8b0-2e55-4679-bde2-a32d1119f1c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converting VIF {"id": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "address": "fa:16:3e:26:54:c5", "network": {"id": "0b93bdd4-546a-4196-b65f-fd517c9500af", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1967042699-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ef08c827c91436bb907130af0c4f031", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18ea8a14-d0", "ovs_interfaceid": "18ea8a14-d0f5-4b66-a0fc-3c1c0b774177", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:54:c5,bridge_name='br-int',has_traffic_filtering=True,id=18ea8a14-d0f5-4b66-a0fc-3c1c0b774177,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ea8a14-d0') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_vif [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:54:c5,bridge_name='br-int',has_traffic_filtering=True,id=18ea8a14-d0f5-4b66-a0fc-3c1c0b774177,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ea8a14-d0') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18ea8a14-d0, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78b286c3-d991-413a-98bd-8878be808d18) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:33:59 user nova-compute[75993]: INFO os_vif [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:54:c5,bridge_name='br-int',has_traffic_filtering=True,id=18ea8a14-d0f5-4b66-a0fc-3c1c0b774177,network=Network(0b93bdd4-546a-4196-b65f-fd517c9500af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18ea8a14-d0')
Nov 08 22:33:59 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BDhycXqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:33:59 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[137ef8ce-6202-4c35-b48f-7dac5274186d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:33:59 user nova-compute[75993]: No targets found.
Nov 08 22:33:59 user nova-compute[75993]: iSNS:
Nov 08 22:33:59 user nova-compute[75993]: No targets found.
Nov 08 22:33:59 user nova-compute[75993]: STATIC:
Nov 08 22:33:59 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036
Nov 08 22:33:59 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:33:59 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:33:59 user nova-compute[75993]: FIRMWARE:
Nov 08 22:33:59 user nova-compute[75993]: No targets found.
Nov 08 22:33:59 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:33:59 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:33:59 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[374bd93a-b120-42ff-88b6-335011fba9b1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5521563-eafb-4f91-95fa-7f93d43e62f0]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:33:59 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 (non-flash)
Nov 08 22:33:59 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544df1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23ae823-3be3-46db-a17d-ede0282dc175]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e03a9a-3f7f-4931-8615-3448368d1dce]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4efb07-dd29-4639-8fdf-4953fbef7c51]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:33:59 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24e1e01-2c05-4e2a-b578-bb4ceb55787f]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[af31073e-cac2-491f-9e08-101069972f55]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[930f6a00-cd12-4192-a301-259a87786732]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260]
Nov 08 22:34:00 user nova-compute[75993]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036, portal: 172.16.0.220,3260] successful.
Nov 08 22:34:00 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4852d97-3bb7-47bb-8e1e-e96bb215c036 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[16578d8f-a9ba-4550-9ee1-fef2f8f2f435]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] <== disconnect_volume: return (323ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:34:00 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Deleting instance files /opt/stack/data/nova/instances/2299c8b0-2e55-4679-bde2-a32d1119f1c4_del
Nov 08 22:34:00 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Deletion of /opt/stack/data/nova/instances/2299c8b0-2e55-4679-bde2-a32d1119f1c4_del complete
Nov 08 22:34:00 user nova-compute[75993]: INFO nova.compute.manager [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 08 22:34:00 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:34:00 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:34:00 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Took 0.37 seconds to deallocate network for instance.
Nov 08 22:34:00 user nova-compute[75993]: DEBUG nova.compute.manager [req-7dc7c705-5a95-42f1-b7e5-2d0f3989da62 req-294afdf9-aa8f-4bdb-bd4b-491bd73ce197 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received event network-vif-deleted-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:34:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-466956ec-b7da-43ed-a1f4-1a77f2aad284 req-daaa165c-29c2-4d9d-b9e3-6fac8bfdded7 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received event network-vif-plugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:34:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-466956ec-b7da-43ed-a1f4-1a77f2aad284 req-daaa165c-29c2-4d9d-b9e3-6fac8bfdded7 service nova] Acquiring lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:34:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-466956ec-b7da-43ed-a1f4-1a77f2aad284 req-daaa165c-29c2-4d9d-b9e3-6fac8bfdded7 service nova] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:34:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-466956ec-b7da-43ed-a1f4-1a77f2aad284 req-daaa165c-29c2-4d9d-b9e3-6fac8bfdded7 service nova] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:34:01 user nova-compute[75993]: DEBUG nova.compute.manager [req-466956ec-b7da-43ed-a1f4-1a77f2aad284 req-daaa165c-29c2-4d9d-b9e3-6fac8bfdded7 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] No waiting events found dispatching network-vif-plugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:34:01 user nova-compute[75993]: WARNING nova.compute.manager [req-466956ec-b7da-43ed-a1f4-1a77f2aad284 req-daaa165c-29c2-4d9d-b9e3-6fac8bfdded7 service nova] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Received unexpected event network-vif-plugged-18ea8a14-d0f5-4b66-a0fc-3c1c0b774177 for instance with vm_state active and task_state deleting.
Nov 08 22:34:01 user nova-compute[75993]: INFO nova.compute.manager [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] [instance: 2299c8b0-2e55-4679-bde2-a32d1119f1c4] Took 1.09 seconds to detach 1 volumes for instance.
Nov 08 22:34:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:34:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:34:01 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:34:01 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:34:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:34:01 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Deleted allocations for instance 2299c8b0-2e55-4679-bde2-a32d1119f1c4
Nov 08 22:34:01 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-04343c21-c1ed-4452-9542-bc7088872e36 tempest-TestVolumeBootPattern-1717039666 tempest-TestVolumeBootPattern-1717039666-project-member] Lock "2299c8b0-2e55-4679-bde2-a32d1119f1c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.946s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:34:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:34:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:34:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:34:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:34:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:34:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:34:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:34:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:34:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:34:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:34:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:34:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:34:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:34:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:34:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:34:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:34:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:34:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:34:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:34:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:34:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:34:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:34:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:34:40 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:34:41 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:34:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:34:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:34:41 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:34:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:34:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:34:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:34:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:34:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:34:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:34:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:34:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:34:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:34:47 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:34:47 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:34:47 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=24.957523345947266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:34:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:34:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:34:48 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:34:48 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:34:48 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:34:48 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:34:48 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:34:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:34:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:34:49 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:34:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:34:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:34:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:34:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:34:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:34:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:34:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:34:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:34:55 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:34:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:34:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:05 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:13 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:19 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:35:24 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:29 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:34 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:39 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:42 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:35:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:35:42 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:35:42 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:44 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:35:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:35:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:35:48 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:35:48 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:35:48 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:35:48 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9098MB free_disk=24.93966293334961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:35:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:35:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.224s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:35:49 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:35:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:35:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:54 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 22:35:55 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 22:35:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:56 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 22:35:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:35:57 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:35:59 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:01 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:04 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:06 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:09 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Starting instance... {{(pid=75993) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75993) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 08 22:36:11 user nova-compute[75993]: INFO nova.compute.claims [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Claim successful on node user
Nov 08 22:36:11 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Start building networks asynchronously for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Allocating IP information in the background. {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] allocate_for_instance() {{(pid=75993) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 08 22:36:11 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 08 22:36:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Start building block device mappings for instance. {{(pid=75993) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG nova.policy [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3a0a9f1a1d24cc0afc0a0470852a0bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '327e3050bb494f2b91acd825723e47b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75993) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Start spawning the instance on the hypervisor. {{(pid=75993) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Creating instance directory {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 08 22:36:11 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Creating image(s)
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "/opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "/opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "/opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "3eed4b5833827bbf000990115cb9d379acdad6be" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.179s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:36:11 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk 1073741824 {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be,backing_fmt=raw /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk 1073741824" returned: 0 in 0.055s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "3eed4b5833827bbf000990115cb9d379acdad6be" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Successfully created port: 14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3eed4b5833827bbf000990115cb9d379acdad6be --force-share --output=json" returned: 0 in 0.184s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk. size=1073741824 {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG nova.virt.disk.api [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Cannot resize image /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk to a smaller size. {{(pid=75993) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Created local disks {{(pid=75993) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Ensure instance console log exists: /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/console.log {{(pid=75993) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Successfully updated port: 14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquired lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Building network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-0aff1f03-432e-4c12-8331-0e6ae83fd93d req-483b9025-a8ea-4795-9d5e-0b628ef8018a service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Received event network-changed-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG nova.compute.manager [req-0aff1f03-432e-4c12-8331-0e6ae83fd93d req-483b9025-a8ea-4795-9d5e-0b628ef8018a service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Refreshing instance network info cache due to event network-changed-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0aff1f03-432e-4c12-8331-0e6ae83fd93d req-483b9025-a8ea-4795-9d5e-0b628ef8018a service nova] Acquiring lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:36:12 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Instance cache missing network info. {{(pid=75993) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.network.neutron [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updating instance_info_cache with network_info: [{"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Releasing lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Instance network_info: |[{"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75993) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0aff1f03-432e-4c12-8331-0e6ae83fd93d req-483b9025-a8ea-4795-9d5e-0b628ef8018a service nova] Acquired lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.network.neutron [req-0aff1f03-432e-4c12-8331-0e6ae83fd93d req-483b9025-a8ea-4795-9d5e-0b628ef8018a service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Refreshing network info cache for port 14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Start _get_guest_xml network_info=[{"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encrypted': False, 'encryption_options': None, 'boot_index': 0, 'encryption_format': None, 'image_id': '6094807b-c5f6-4b2a-ac9a-5175832ce24b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 08 22:36:13 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:36:13 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] CPU controller missing on host. {{(pid=75993) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.host [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] CPU controller found on host. {{(pid=75993) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75993) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-08T21:30:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-08T21:30:12Z,direct_url=<?>,disk_format='qcow2',id=6094807b-c5f6-4b2a-ac9a-5175832ce24b,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='595af569c4ed47aa9b06f30e79e17e76',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-08T21:30:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Flavor limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Image limits 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Flavor pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Image pref 0:0:0 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Got 1 possible topologies {{(pid=75993) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.hardware [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75993) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1939854982',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1939854982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1939854',id=52,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/DpB88ZXiExDLfq+k3pkMGe19pH+XgRpBLeojh1M8O9j9H1MTNqaHYwl+crBPE4cjL0o6WdFtuJRXqIPwLc3wjjqcr1Q7CtDmS48GZzDinPk5tol1F4syWmfDSZYyVrQ==',key_name='tempest-keypair-1348205073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='327e3050bb494f2b91acd825723e47b7',ramdisk_id='',reservation_id='r-xigapybf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1680560215',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a0a9f1a1d24cc0afc0a0470852a0bb',uuid=282739cb-2d83-4a9c-8c28-a2cde014c6bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75993) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Converting VIF {"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:eb:90,bridge_name='br-int',has_traffic_filtering=True,id=14e72aa1-bc0e-4578-94c2-fe6f23fe65bb,network=Network(72d50db2-84e4-4251-aac2-d08a1e7cdd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e72aa1-bc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.objects.instance [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lazy-loading 'pci_devices' on Instance uuid 282739cb-2d83-4a9c-8c28-a2cde014c6bc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] End _get_guest_xml xml=<domain type="kvm">
Nov 08 22:36:13 user nova-compute[75993]:   <uuid>282739cb-2d83-4a9c-8c28-a2cde014c6bc</uuid>
Nov 08 22:36:13 user nova-compute[75993]:   <name>instance-00000034</name>
Nov 08 22:36:13 user nova-compute[75993]:   <memory>524288</memory>
Nov 08 22:36:13 user nova-compute[75993]:   <vcpu>1</vcpu>
Nov 08 22:36:13 user nova-compute[75993]:   <metadata>
Nov 08 22:36:13 user nova-compute[75993]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 08 22:36:13 user nova-compute[75993]:       <nova:package version="0.0.0"/>
Nov 08 22:36:13 user nova-compute[75993]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1939854982</nova:name>
Nov 08 22:36:13 user nova-compute[75993]:       <nova:creationTime>2023-11-08 22:36:13</nova:creationTime>
Nov 08 22:36:13 user nova-compute[75993]:       <nova:flavor name="m1.tiny">
Nov 08 22:36:13 user nova-compute[75993]:         <nova:memory>512</nova:memory>
Nov 08 22:36:13 user nova-compute[75993]:         <nova:disk>1</nova:disk>
Nov 08 22:36:13 user nova-compute[75993]:         <nova:swap>0</nova:swap>
Nov 08 22:36:13 user nova-compute[75993]:         <nova:ephemeral>0</nova:ephemeral>
Nov 08 22:36:13 user nova-compute[75993]:         <nova:vcpus>1</nova:vcpus>
Nov 08 22:36:13 user nova-compute[75993]:       </nova:flavor>
Nov 08 22:36:13 user nova-compute[75993]:       <nova:owner>
Nov 08 22:36:13 user nova-compute[75993]:         <nova:user uuid="d3a0a9f1a1d24cc0afc0a0470852a0bb">tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member</nova:user>
Nov 08 22:36:13 user nova-compute[75993]:         <nova:project uuid="327e3050bb494f2b91acd825723e47b7">tempest-TestServerVolumeAttachScenarioOldVersion-1680560215</nova:project>
Nov 08 22:36:13 user nova-compute[75993]:       </nova:owner>
Nov 08 22:36:13 user nova-compute[75993]:       <nova:root type="image" uuid="6094807b-c5f6-4b2a-ac9a-5175832ce24b"/>
Nov 08 22:36:13 user nova-compute[75993]:       <nova:ports>
Nov 08 22:36:13 user nova-compute[75993]:         <nova:port uuid="14e72aa1-bc0e-4578-94c2-fe6f23fe65bb">
Nov 08 22:36:13 user nova-compute[75993]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 08 22:36:13 user nova-compute[75993]:         </nova:port>
Nov 08 22:36:13 user nova-compute[75993]:       </nova:ports>
Nov 08 22:36:13 user nova-compute[75993]:     </nova:instance>
Nov 08 22:36:13 user nova-compute[75993]:   </metadata>
Nov 08 22:36:13 user nova-compute[75993]:   <sysinfo type="smbios">
Nov 08 22:36:13 user nova-compute[75993]:     <system>
Nov 08 22:36:13 user nova-compute[75993]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 08 22:36:13 user nova-compute[75993]:       <entry name="product">OpenStack Nova</entry>
Nov 08 22:36:13 user nova-compute[75993]:       <entry name="version">0.0.0</entry>
Nov 08 22:36:13 user nova-compute[75993]:       <entry name="serial">282739cb-2d83-4a9c-8c28-a2cde014c6bc</entry>
Nov 08 22:36:13 user nova-compute[75993]:       <entry name="uuid">282739cb-2d83-4a9c-8c28-a2cde014c6bc</entry>
Nov 08 22:36:13 user nova-compute[75993]:       <entry name="family">Virtual Machine</entry>
Nov 08 22:36:13 user nova-compute[75993]:     </system>
Nov 08 22:36:13 user nova-compute[75993]:   </sysinfo>
Nov 08 22:36:13 user nova-compute[75993]:   <os>
Nov 08 22:36:13 user nova-compute[75993]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 08 22:36:13 user nova-compute[75993]:     <boot dev="hd"/>
Nov 08 22:36:13 user nova-compute[75993]:     <smbios mode="sysinfo"/>
Nov 08 22:36:13 user nova-compute[75993]:   </os>
Nov 08 22:36:13 user nova-compute[75993]:   <features>
Nov 08 22:36:13 user nova-compute[75993]:     <acpi/>
Nov 08 22:36:13 user nova-compute[75993]:     <apic/>
Nov 08 22:36:13 user nova-compute[75993]:     <vmcoreinfo/>
Nov 08 22:36:13 user nova-compute[75993]:   </features>
Nov 08 22:36:13 user nova-compute[75993]:   <clock offset="utc">
Nov 08 22:36:13 user nova-compute[75993]:     <timer name="pit" tickpolicy="delay"/>
Nov 08 22:36:13 user nova-compute[75993]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 08 22:36:13 user nova-compute[75993]:     <timer name="hpet" present="no"/>
Nov 08 22:36:13 user nova-compute[75993]:   </clock>
Nov 08 22:36:13 user nova-compute[75993]:   <cpu mode="custom" match="exact">
Nov 08 22:36:13 user nova-compute[75993]:     <model>Nehalem</model>
Nov 08 22:36:13 user nova-compute[75993]:     <topology sockets="1" cores="1" threads="1"/>
Nov 08 22:36:13 user nova-compute[75993]:   </cpu>
Nov 08 22:36:13 user nova-compute[75993]:   <devices>
Nov 08 22:36:13 user nova-compute[75993]:     <disk type="file" device="disk">
Nov 08 22:36:13 user nova-compute[75993]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 08 22:36:13 user nova-compute[75993]:       <source file="/opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk"/>
Nov 08 22:36:13 user nova-compute[75993]:       <target dev="vda" bus="virtio"/>
Nov 08 22:36:13 user nova-compute[75993]:     </disk>
Nov 08 22:36:13 user nova-compute[75993]:     <interface type="ethernet">
Nov 08 22:36:13 user nova-compute[75993]:       <mac address="fa:16:3e:1a:eb:90"/>
Nov 08 22:36:13 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:36:13 user nova-compute[75993]:       <mtu size="1442"/>
Nov 08 22:36:13 user nova-compute[75993]:       <target dev="tap14e72aa1-bc"/>
Nov 08 22:36:13 user nova-compute[75993]:     </interface>
Nov 08 22:36:13 user nova-compute[75993]:     <serial type="pty">
Nov 08 22:36:13 user nova-compute[75993]:       <log file="/opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/console.log" append="off"/>
Nov 08 22:36:13 user nova-compute[75993]:     </serial>
Nov 08 22:36:13 user nova-compute[75993]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 08 22:36:13 user nova-compute[75993]:     <video>
Nov 08 22:36:13 user nova-compute[75993]:       <model type="virtio"/>
Nov 08 22:36:13 user nova-compute[75993]:     </video>
Nov 08 22:36:13 user nova-compute[75993]:     <rng model="virtio">
Nov 08 22:36:13 user nova-compute[75993]:       <backend model="random">/dev/urandom</backend>
Nov 08 22:36:13 user nova-compute[75993]:     </rng>
Nov 08 22:36:13 user nova-compute[75993]:     <controller type="usb" index="0" model="none"/>
Nov 08 22:36:13 user nova-compute[75993]:     <memballoon model="virtio">
Nov 08 22:36:13 user nova-compute[75993]:       <stats period="10"/>
Nov 08 22:36:13 user nova-compute[75993]:     </memballoon>
Nov 08 22:36:13 user nova-compute[75993]:   </devices>
Nov 08 22:36:13 user nova-compute[75993]: </domain>
Nov 08 22:36:13 user nova-compute[75993]:  {{(pid=75993) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1939854982',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1939854982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1939854',id=52,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/DpB88ZXiExDLfq+k3pkMGe19pH+XgRpBLeojh1M8O9j9H1MTNqaHYwl+crBPE4cjL0o6WdFtuJRXqIPwLc3wjjqcr1Q7CtDmS48GZzDinPk5tol1F4syWmfDSZYyVrQ==',key_name='tempest-keypair-1348205073',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='327e3050bb494f2b91acd825723e47b7',ramdisk_id='',reservation_id='r-xigapybf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1680560215',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-08T22:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a0a9f1a1d24cc0afc0a0470852a0bb',uuid=282739cb-2d83-4a9c-8c28-a2cde014c6bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Converting VIF {"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:eb:90,bridge_name='br-int',has_traffic_filtering=True,id=14e72aa1-bc0e-4578-94c2-fe6f23fe65bb,network=Network(72d50db2-84e4-4251-aac2-d08a1e7cdd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e72aa1-bc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG os_vif [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:eb:90,bridge_name='br-int',has_traffic_filtering=True,id=14e72aa1-bc0e-4578-94c2-fe6f23fe65bb,network=Network(72d50db2-84e4-4251-aac2-d08a1e7cdd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e72aa1-bc') {{(pid=75993) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90434ab5-1e4a-5a30-9710-812abb0ed1b0', '_type': 'linux-noop'}}, row=False) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14e72aa1-bc, may_exist=True, interface_attrs={}) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap14e72aa1-bc, col_values=(('qos', UUID('1961029a-aba4-42e0-afc7-dafe625c340d')),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap14e72aa1-bc, col_values=(('external_ids', {'iface-id': '14e72aa1-bc0e-4578-94c2-fe6f23fe65bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:eb:90', 'vm-uuid': '282739cb-2d83-4a9c-8c28-a2cde014c6bc'}),), if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:13 user nova-compute[75993]: INFO os_vif [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:eb:90,bridge_name='br-int',has_traffic_filtering=True,id=14e72aa1-bc0e-4578-94c2-fe6f23fe65bb,network=Network(72d50db2-84e4-4251-aac2-d08a1e7cdd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e72aa1-bc')
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] No VIF found with MAC fa:16:3e:1a:eb:90, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.network.neutron [req-0aff1f03-432e-4c12-8331-0e6ae83fd93d req-483b9025-a8ea-4795-9d5e-0b628ef8018a service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updated VIF entry in instance network info cache for port 14e72aa1-bc0e-4578-94c2-fe6f23fe65bb. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG nova.network.neutron [req-0aff1f03-432e-4c12-8331-0e6ae83fd93d req-483b9025-a8ea-4795-9d5e-0b628ef8018a service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updating instance_info_cache with network_info: [{"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:36:13 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-0aff1f03-432e-4c12-8331-0e6ae83fd93d req-483b9025-a8ea-4795-9d5e-0b628ef8018a service nova] Releasing lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:36:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:14 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-6dab42fd-4755-4ab5-b2d8-59a01b0ee1b3 req-41e513a6-1f06-477d-a6a3-94194448e7b5 service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Received event network-vif-plugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:36:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6dab42fd-4755-4ab5-b2d8-59a01b0ee1b3 req-41e513a6-1f06-477d-a6a3-94194448e7b5 service nova] Acquiring lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:36:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6dab42fd-4755-4ab5-b2d8-59a01b0ee1b3 req-41e513a6-1f06-477d-a6a3-94194448e7b5 service nova] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:36:14 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-6dab42fd-4755-4ab5-b2d8-59a01b0ee1b3 req-41e513a6-1f06-477d-a6a3-94194448e7b5 service nova] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:36:14 user nova-compute[75993]: DEBUG nova.compute.manager [req-6dab42fd-4755-4ab5-b2d8-59a01b0ee1b3 req-41e513a6-1f06-477d-a6a3-94194448e7b5 service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] No waiting events found dispatching network-vif-plugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:36:14 user nova-compute[75993]: WARNING nova.compute.manager [req-6dab42fd-4755-4ab5-b2d8-59a01b0ee1b3 req-41e513a6-1f06-477d-a6a3-94194448e7b5 service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Received unexpected event network-vif-plugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb for instance with vm_state building and task_state spawning.
Nov 08 22:36:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:15 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Instance event wait completed in 0 seconds for  {{(pid=75993) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Guest created on hypervisor {{(pid=75993) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 08 22:36:16 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Instance spawned successfully.
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Found default for hw_cdrom_bus of ide {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Found default for hw_disk_bus of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Found default for hw_input_bus of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Found default for hw_pointer_model of None {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Found default for hw_video_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Found default for hw_vif_model of virtio {{(pid=75993) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 08 22:36:16 user nova-compute[75993]: INFO nova.compute.manager [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Took 5.09 seconds to spawn the instance on the hypervisor.
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.compute.manager [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Checking state {{(pid=75993) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 08 22:36:16 user nova-compute[75993]: INFO nova.compute.manager [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Took 5.60 seconds to build instance.
Nov 08 22:36:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-e7197257-f035-45d0-88de-f7eaf57ef9cb tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.694s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-320de06e-8fa7-4ff2-bed3-cd4374e86d12 req-b3ea53fb-aedf-441a-8d0a-b2bfc30f97c4 service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Received event network-vif-plugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-320de06e-8fa7-4ff2-bed3-cd4374e86d12 req-b3ea53fb-aedf-441a-8d0a-b2bfc30f97c4 service nova] Acquiring lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-320de06e-8fa7-4ff2-bed3-cd4374e86d12 req-b3ea53fb-aedf-441a-8d0a-b2bfc30f97c4 service nova] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-320de06e-8fa7-4ff2-bed3-cd4374e86d12 req-b3ea53fb-aedf-441a-8d0a-b2bfc30f97c4 service nova] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:36:16 user nova-compute[75993]: DEBUG nova.compute.manager [req-320de06e-8fa7-4ff2-bed3-cd4374e86d12 req-b3ea53fb-aedf-441a-8d0a-b2bfc30f97c4 service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] No waiting events found dispatching network-vif-plugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:36:16 user nova-compute[75993]: WARNING nova.compute.manager [req-320de06e-8fa7-4ff2-bed3-cd4374e86d12 req-b3ea53fb-aedf-441a-8d0a-b2bfc30f97c4 service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Received unexpected event network-vif-plugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb for instance with vm_state active and task_state None.
Nov 08 22:36:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:36:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:36:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:36:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:36:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:36:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:36:44 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:36:44 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 282739cb-2d83-4a9c-8c28-a2cde014c6bc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:36:44 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updating instance_info_cache with network_info: [{"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:36:44 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:36:44 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:36:44 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:36:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:36:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:36:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:36:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:36:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:36:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:36:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:36:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:36:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:36:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:36:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:36:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:36:50 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:36:50 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:36:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=24.90903091430664GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:36:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 282739cb-2d83-4a9c-8c28-a2cde014c6bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:36:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:36:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:36:50 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:36:50 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:36:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:36:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.191s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:36:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:36:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:36:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:36:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:36:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:36:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:37:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:37:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:37:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:37:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:37:14 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:37:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:37:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:37:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:37:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:37:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:37:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:37:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:37:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:37:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:37:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:37:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:37:46 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:37:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:37:46 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:37:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:37:46 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:37:46 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 282739cb-2d83-4a9c-8c28-a2cde014c6bc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:37:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updating instance_info_cache with network_info: [{"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:37:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:37:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:37:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:37:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:37:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:37:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:37:49 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:37:49 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:37:50 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:37:50 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:37:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8959MB free_disk=24.908477783203125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:37:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 282739cb-2d83-4a9c-8c28-a2cde014c6bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:37:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:37:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:37:50 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:37:50 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:37:50 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:37:50 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:37:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:37:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:37:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:37:52 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:37:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:37:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:37:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:37:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:37:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:37:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:37:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:38:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-40f2ddab-cb0f-4491-a208-81331d32fca2 req-8b37e984-4c12-4459-9ea4-67298240df9d service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Received event network-changed-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:38:02 user nova-compute[75993]: DEBUG nova.compute.manager [req-40f2ddab-cb0f-4491-a208-81331d32fca2 req-8b37e984-4c12-4459-9ea4-67298240df9d service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Refreshing instance network info cache due to event network-changed-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb. {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 08 22:38:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-40f2ddab-cb0f-4491-a208-81331d32fca2 req-8b37e984-4c12-4459-9ea4-67298240df9d service nova] Acquiring lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:38:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-40f2ddab-cb0f-4491-a208-81331d32fca2 req-8b37e984-4c12-4459-9ea4-67298240df9d service nova] Acquired lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:38:02 user nova-compute[75993]: DEBUG nova.network.neutron [req-40f2ddab-cb0f-4491-a208-81331d32fca2 req-8b37e984-4c12-4459-9ea4-67298240df9d service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Refreshing network info cache for port 14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 08 22:38:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:02 user nova-compute[75993]: DEBUG nova.network.neutron [req-40f2ddab-cb0f-4491-a208-81331d32fca2 req-8b37e984-4c12-4459-9ea4-67298240df9d service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updated VIF entry in instance network info cache for port 14e72aa1-bc0e-4578-94c2-fe6f23fe65bb. {{(pid=75993) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 08 22:38:02 user nova-compute[75993]: DEBUG nova.network.neutron [req-40f2ddab-cb0f-4491-a208-81331d32fca2 req-8b37e984-4c12-4459-9ea4-67298240df9d service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updating instance_info_cache with network_info: [{"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:38:02 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-40f2ddab-cb0f-4491-a208-81331d32fca2 req-8b37e984-4c12-4459-9ea4-67298240df9d service nova] Releasing lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:38:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:38:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:38:09 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lazy-loading 'flavor' on Instance uuid 282739cb-2d83-4a9c-8c28-a2cde014c6bc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:38:09 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:38:10 user nova-compute[75993]: INFO nova.compute.manager [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Attaching volume 71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b to /dev/vdb
Nov 08 22:38:10 user nova-compute[75993]: DEBUG os_brick.utils [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1ad841-c018-4514-9f2b-231dd634fc50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38b2d9bd1fa\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45bcb62-c7a3-45c1-9f70-be58f1057e9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[28084e6d-5713-4267-ab48-c3b066e37d84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[414e2eba-e462-4513-9923-5d06d132d395]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Running cmd (subprocess): nvme version {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] 'nvme version' failed. Not Retrying. {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] nvme not present on system {{(pid=75993) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 08 22:38:10 user nova-compute[75993]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 08 22:38:10 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[acad1a3e-b0cf-4112-a441-55aa87e85506]: (4, '') {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75993) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.lightos [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] LIGHTOS: no hostnqn found. {{(pid=75993) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG os_brick.utils [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38b2d9bd1fa', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:38:10 user nova-compute[75993]: DEBUG nova.virt.block_device [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updating existing volume attachment record: 13373734-6498-4a8e-999f-88d0b9a7e2e2 {{(pid=75993) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 08 22:38:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:38:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:38:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:38:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:38:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:38:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Calling os-brick to attach iSCSI Volume {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSvrWVjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:38:43 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:38:43 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:38:43 user nova-compute[75993]: INFO os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 08 22:38:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bef0551-667c-4f6c-80ac-87399c0a7cfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 08 22:38:43 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acf9c6b-e912-40dc-8a2f-0517a95d9306]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b] added\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b] added
Nov 08 22:38:43 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fcff33-769c-48c0-a076-dc86fbd36f7d]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95086f3-a405-4cf0-b4aa-65282047350f]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSvrWVjZ {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hSvrWVjZ" returned: 0 in 0.023s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5f190b-fac3-4086-b168-ffa74af8bff1]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hSvrWVjZ'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[886df35f-7543-4281-8814-6f237773ef2a]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c26c077-5035-4347-9616-99005c71c95b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:38:43 user nova-compute[75993]:  {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 08 22:38:43 user nova-compute[75993]:  {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:38:43 user nova-compute[75993]: WARNING os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 08 22:38:43 user nova-compute[75993]: 
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --login {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e350f0c0-0440-4da4-a908-17f4a49840bb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b, portal: 172.16.0.220,3260]
Nov 08 22:38:43 user nova-compute[75993]: Login to [iface: default, target: iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b, portal: 172.16.0.220,3260] successful.
Nov 08 22:38:43 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8decc88-ed51-4e06-ab9a-99f2e00cdb64]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4374a031-7edf-48e5-a0ee-b7ed7897789f]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b (non-flash)
Nov 08 22:38:43 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b (non-flash)
Nov 08 22:38:43 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Connected to 172.16.0.220:3260 {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75993) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75993) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[924a33ee-0746-4fde-a432-a6501f844ccc]: (4, ('- - 0', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75993) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 08 22:38:43 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSvrWVjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75993) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 08 22:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:38:44 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23839326534336435', 'path': '/dev/sdb'} {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:38:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839326534336435', 'path': '/dev/sdb'} {{(pid=75993) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 08 22:38:44 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lazy-loading 'flavor' on Instance uuid 282739cb-2d83-4a9c-8c28-a2cde014c6bc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:38:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] attach device xml: <disk type="block" device="disk">
Nov 08 22:38:44 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:38:44 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:38:44 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:38:44 user nova-compute[75993]:   <serial>71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b</serial>
Nov 08 22:38:44 user nova-compute[75993]: </disk>
Nov 08 22:38:44 user nova-compute[75993]:  {{(pid=75993) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 08 22:38:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] No BDM found with device name vda, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:38:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75993) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 08 22:38:44 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] No VIF found with MAC fa:16:3e:1a:eb:90, not building metadata {{(pid=75993) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 08 22:38:45 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9e89528-60e9-4dc6-be73-9f133821b3e0 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.038s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:38:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:38:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:38:46 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:38:46 user nova-compute[75993]: INFO nova.compute.manager [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Detaching volume 71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b
Nov 08 22:38:46 user nova-compute[75993]: INFO nova.virt.block_device [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Attempting to driver detach volume 71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b from mountpoint /dev/vdb
Nov 08 22:38:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Attempting to detach device vdb from instance 282739cb-2d83-4a9c-8c28-a2cde014c6bc from the persistent domain config. {{(pid=75993) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 08 22:38:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:38:46 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:38:46 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:38:46 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:38:46 user nova-compute[75993]:   <serial>71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b</serial>
Nov 08 22:38:46 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:38:46 user nova-compute[75993]: </disk>
Nov 08 22:38:46 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:38:46 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Successfully detached device vdb from instance 282739cb-2d83-4a9c-8c28-a2cde014c6bc from the persistent domain config.
Nov 08 22:38:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 282739cb-2d83-4a9c-8c28-a2cde014c6bc from the live domain config. {{(pid=75993) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 08 22:38:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.guest [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] detach device xml: <disk type="block" device="disk">
Nov 08 22:38:46 user nova-compute[75993]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 08 22:38:46 user nova-compute[75993]:   <source dev="/dev/sdb"/>
Nov 08 22:38:46 user nova-compute[75993]:   <target dev="vdb" bus="virtio"/>
Nov 08 22:38:46 user nova-compute[75993]:   <serial>71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b</serial>
Nov 08 22:38:46 user nova-compute[75993]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 08 22:38:46 user nova-compute[75993]: </disk>
Nov 08 22:38:46 user nova-compute[75993]:  {{(pid=75993) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 08 22:38:46 user nova-compute[75993]: DEBUG nova.virt.libvirt.driver [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 282739cb-2d83-4a9c-8c28-a2cde014c6bc {{(pid=75993) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 08 22:38:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:38:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:38:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 08 22:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquired lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 08 22:38:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Forcefully refreshing network info cache for instance {{(pid=75993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 08 22:38:47 user nova-compute[75993]: DEBUG nova.objects.instance [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lazy-loading 'info_cache' on Instance uuid 282739cb-2d83-4a9c-8c28-a2cde014c6bc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:38:47 user nova-compute[75993]: DEBUG nova.network.neutron [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updating instance_info_cache with network_info: [{"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:38:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Releasing lock "refresh_cache-282739cb-2d83-4a9c-8c28-a2cde014c6bc" {{(pid=75993) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 08 22:38:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updated the network info_cache for instance {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 08 22:38:47 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:38:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:38:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:38:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:38:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:38:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:38:48 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:38:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:38:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:38:51 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:38:51 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75993) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:38:52 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:38:52 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:38:52 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=8916MB free_disk=24.899341583251953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:38:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:38:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:38:52 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Instance 282739cb-2d83-4a9c-8c28-a2cde014c6bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75993) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 08 22:38:52 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:38:52 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:38:52 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:38:52 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:38:52 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:38:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:38:53 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:38:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:38:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:38:58 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:38:58 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:39:03 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:39:06 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 282739cb-2d83-4a9c-8c28-a2cde014c6bc is timed out.
Nov 08 22:39:06 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Successfully detached device vdb from instance 282739cb-2d83-4a9c-8c28-a2cde014c6bc from the live domain config.
Nov 08 22:39:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] calling os-brick to detach iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f856831e440>, {'target_iqn': 'iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hSvrWVjZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 08 22:39:06 user nova-compute[75993]: WARNING os_brick.initiator.connectors.base [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f275e46-bb3f-4fa8-bbfb-719e14dd437f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 08 22:39:06 user nova-compute[75993]: No targets found.
Nov 08 22:39:06 user nova-compute[75993]: iSNS:
Nov 08 22:39:06 user nova-compute[75993]: No targets found.
Nov 08 22:39:06 user nova-compute[75993]: STATIC:
Nov 08 22:39:06 user nova-compute[75993]: Target: iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b
Nov 08 22:39:06 user nova-compute[75993]:         Portal: 172.16.0.220:3260,-1
Nov 08 22:39:06 user nova-compute[75993]:                 Iface Name: default
Nov 08 22:39:06 user nova-compute[75993]: FIRMWARE:
Nov 08 22:39:06 user nova-compute[75993]: No targets found.
Nov 08 22:39:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 08 22:39:06 user nova-compute[75993]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 08 22:39:06 user nova-compute[75993]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75993) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b', 0)] {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a97fb12-4355-4f8f-b07e-e47c86b5bf8f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d58caff-dd5a-40d0-b011-3851e2e4bead]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b (non-flash)\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b (non-flash)
Nov 08 22:39:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b (non-flash)
Nov 08 22:39:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f8544bca560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b'): ({'sdb'}, set())}) {{(pid=75993) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Removing single pathed devices sdb {{(pid=75993) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f7695f-bd9d-4c5b-87ae-48dbbdb0ef2c]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[12879aed-6f53-4f79-8053-78d6ad3f7c11]: (4, ('ok\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Flushing IO for device /dev/sdb {{(pid=75993) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff16c35-5675-4f12-9dca-975c87dcb575]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75993) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f640b58-0325-43a7-8bc2-d680ce9593c8]: (4, ('1', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.linuxscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] SCSI volumes sdb have been removed. {{(pid=75993) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b')] {{(pid=75993) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a0aebd-27b9-4a46-bb27-4e27faef76ae]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --logout {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.038s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[e707ec38-1004-4acb-962e-9bef8d98dec2]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b, portal: 172.16.0.220,3260]
Nov 08 22:39:06 user nova-compute[75993]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b, portal: 172.16.0.220,3260] successful.
Nov 08 22:39:06 user nova-compute[75993]:  stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op delete {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71f2cee8-2538-43d6-a9ee-5c7b7edfbf7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86999) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG oslo.privsep.daemon [-] privsep: reply[408facc2-99af-4b9b-9d17-e8108641f6e0]: (4, ('', '')) {{(pid=86999) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75993) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.base [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] <== disconnect_volume: return (277ms) None {{(pid=75993) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 08 22:39:06 user nova-compute[75993]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Disconnected iSCSI Volume {{(pid=75993) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 08 22:39:07 user nova-compute[75993]: DEBUG nova.objects.instance [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lazy-loading 'flavor' on Instance uuid 282739cb-2d83-4a9c-8c28-a2cde014c6bc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:39:07 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-5efe0697-49ac-40f9-ad5b-e76f0ecb35c9 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.826s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:39:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:39:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:39:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:39:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:39:08 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:39:13 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:39:15 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:39:18 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:39:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:39:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:39:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:39:23 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:28 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:33 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:39:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:39:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:39:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:39:38 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:39:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:39:47 user nova-compute[75993]: INFO nova.compute.manager [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Terminating instance
Nov 08 22:39:47 user nova-compute[75993]: DEBUG nova.compute.manager [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Start destroying the instance on the hypervisor. {{(pid=75993) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-2a5ea871-a6cd-412d-834b-f95427cc6daa req-09467d35-8b6d-4f95-b6f3-dec8763ff139 service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Received event network-vif-unplugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2a5ea871-a6cd-412d-834b-f95427cc6daa req-09467d35-8b6d-4f95-b6f3-dec8763ff139 service nova] Acquiring lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2a5ea871-a6cd-412d-834b-f95427cc6daa req-09467d35-8b6d-4f95-b6f3-dec8763ff139 service nova] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-2a5ea871-a6cd-412d-834b-f95427cc6daa req-09467d35-8b6d-4f95-b6f3-dec8763ff139 service nova] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-2a5ea871-a6cd-412d-834b-f95427cc6daa req-09467d35-8b6d-4f95-b6f3-dec8763ff139 service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] No waiting events found dispatching network-vif-unplugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG nova.compute.manager [req-2a5ea871-a6cd-412d-834b-f95427cc6daa req-09467d35-8b6d-4f95-b6f3-dec8763ff139 service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Received event network-vif-unplugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb for instance with task_state deleting. {{(pid=75993) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [-] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Instance destroyed successfully.
Nov 08 22:39:47 user nova-compute[75993]: DEBUG nova.objects.instance [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lazy-loading 'resources' on Instance uuid 282739cb-2d83-4a9c-8c28-a2cde014c6bc {{(pid=75993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG nova.virt.libvirt.vif [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-08T22:36:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1939854982',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1939854982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1939854',id=52,image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/DpB88ZXiExDLfq+k3pkMGe19pH+XgRpBLeojh1M8O9j9H1MTNqaHYwl+crBPE4cjL0o6WdFtuJRXqIPwLc3wjjqcr1Q7CtDmS48GZzDinPk5tol1F4syWmfDSZYyVrQ==',key_name='tempest-keypair-1348205073',keypairs=<?>,launch_index=0,launched_at=2023-11-08T22:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='327e3050bb494f2b91acd825723e47b7',ramdisk_id='',reservation_id='r-xigapybf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6094807b-c5f6-4b2a-ac9a-5175832ce24b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1680560215',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-08T22:36:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3a0a9f1a1d24cc0afc0a0470852a0bb',uuid=282739cb-2d83-4a9c-8c28-a2cde014c6bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Converting VIF {"id": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "address": "fa:16:3e:1a:eb:90", "network": {"id": "72d50db2-84e4-4251-aac2-d08a1e7cdd8b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1020185661-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "327e3050bb494f2b91acd825723e47b7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14e72aa1-bc", "ovs_interfaceid": "14e72aa1-bc0e-4578-94c2-fe6f23fe65bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG nova.network.os_vif_util [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:eb:90,bridge_name='br-int',has_traffic_filtering=True,id=14e72aa1-bc0e-4578-94c2-fe6f23fe65bb,network=Network(72d50db2-84e4-4251-aac2-d08a1e7cdd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e72aa1-bc') {{(pid=75993) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG os_vif [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:eb:90,bridge_name='br-int',has_traffic_filtering=True,id=14e72aa1-bc0e-4578-94c2-fe6f23fe65bb,network=Network(72d50db2-84e4-4251-aac2-d08a1e7cdd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e72aa1-bc') {{(pid=75993) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14e72aa1-bc, bridge=br-int, if_exists=True) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1961029a-aba4-42e0-afc7-dafe625c340d) {{(pid=75993) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:39:47 user nova-compute[75993]: INFO os_vif [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:eb:90,bridge_name='br-int',has_traffic_filtering=True,id=14e72aa1-bc0e-4578-94c2-fe6f23fe65bb,network=Network(72d50db2-84e4-4251-aac2-d08a1e7cdd8b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14e72aa1-bc')
Nov 08 22:39:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Deleting instance files /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc_del
Nov 08 22:39:47 user nova-compute[75993]: INFO nova.virt.libvirt.driver [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Deletion of /opt/stack/data/nova/instances/282739cb-2d83-4a9c-8c28-a2cde014c6bc_del complete
Nov 08 22:39:48 user nova-compute[75993]: INFO nova.compute.manager [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 08 22:39:48 user nova-compute[75993]: DEBUG oslo.service.loopingcall [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75993) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 08 22:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [-] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Deallocating network for instance {{(pid=75993) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 08 22:39:48 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] deallocate_for_instance() {{(pid=75993) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 08 22:39:48 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Skipping network cache update for instance because it is being deleted. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 08 22:39:48 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:39:48 user nova-compute[75993]: DEBUG nova.network.neutron [-] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Updating instance_info_cache with network_info: [] {{(pid=75993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 08 22:39:48 user nova-compute[75993]: INFO nova.compute.manager [-] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Took 0.72 seconds to deallocate network for instance.
Nov 08 22:39:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:39:48 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:39:48 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:39:48 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:39:49 user nova-compute[75993]: INFO nova.scheduler.client.report [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Deleted allocations for instance 282739cb-2d83-4a9c-8c28-a2cde014c6bc
Nov 08 22:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-f9b0bf06-ff24-40c4-b9f9-7bafda21edb6 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215 tempest-TestServerVolumeAttachScenarioOldVersion-1680560215-project-member] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.023s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:39:49 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:39:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-83b75e8d-7a96-4eee-8a46-91ba875cb889 req-020749c9-8872-408d-9809-d046a657696d service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Received event network-vif-plugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-83b75e8d-7a96-4eee-8a46-91ba875cb889 req-020749c9-8872-408d-9809-d046a657696d service nova] Acquiring lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-83b75e8d-7a96-4eee-8a46-91ba875cb889 req-020749c9-8872-408d-9809-d046a657696d service nova] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:39:49 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [req-83b75e8d-7a96-4eee-8a46-91ba875cb889 req-020749c9-8872-408d-9809-d046a657696d service nova] Lock "282739cb-2d83-4a9c-8c28-a2cde014c6bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:39:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-83b75e8d-7a96-4eee-8a46-91ba875cb889 req-020749c9-8872-408d-9809-d046a657696d service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] No waiting events found dispatching network-vif-plugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 08 22:39:49 user nova-compute[75993]: WARNING nova.compute.manager [req-83b75e8d-7a96-4eee-8a46-91ba875cb889 req-020749c9-8872-408d-9809-d046a657696d service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Received unexpected event network-vif-plugged-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb for instance with vm_state deleted and task_state None.
Nov 08 22:39:49 user nova-compute[75993]: DEBUG nova.compute.manager [req-83b75e8d-7a96-4eee-8a46-91ba875cb889 req-020749c9-8872-408d-9809-d046a657696d service nova] [instance: 282739cb-2d83-4a9c-8c28-a2cde014c6bc] Received event network-vif-deleted-14e72aa1-bc0e-4578-94c2-fe6f23fe65bb {{(pid=75993) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 08 22:39:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:39:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:39:52 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:39:52 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:39:52 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:39:52 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9074MB free_disk=24.926483154296875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:39:52 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:39:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:53 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:39:53 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:39:53 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:39:53 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:39:53 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:39:53 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:39:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:39:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:39:54 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:39:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:39:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:39:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:39:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:39:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:39:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:39:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:40:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:40:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:40:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:40:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:40:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:40:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:40:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:40:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:40:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:40:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:40:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:40:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:40:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:40:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:40:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:40 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:40:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:40:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:40:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:40:50 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:40:50 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:40:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:40:53 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:40:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:40:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:40:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:40:54 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:40:54 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:40:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9088MB free_disk=24.925182342529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:40:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:40:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:40:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:40:55 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing inventories for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 08 22:40:55 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating ProviderTree inventory for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 08 22:40:55 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Updating inventory in ProviderTree for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 08 22:40:55 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing aggregate associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, aggregates: None {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 08 22:40:55 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Refreshing trait associations for resource provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81, traits: COMPUTE_NODE,HW_CPU_X86_SSE42,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE {{(pid=75993) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 08 22:40:55 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:40:55 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:40:55 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:40:55 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:40:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:40:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:40:56 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:40:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:41:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:02 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:02 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 08 22:41:02 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] There are 0 instances to clean {{(pid=75993) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 08 22:41:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:41:03 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:06 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:06 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75993) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 08 22:41:07 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:41:12 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:41:17 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:41:19 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:22 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:41:27 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:41:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:41:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:41:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75993) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 08 22:41:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:41:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75993) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 08 22:41:32 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:41:37 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:41:42 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:41:43 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:41:45 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:47 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 08 22:41:51 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Starting heal instance info cache {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 08 22:41:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Rebuilding the list of instances to heal {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 08 22:41:51 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Didn't find any instances for network info cache update. {{(pid=75993) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 08 22:41:52 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:52 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Auditing locally available compute resources for user (node: user) {{(pid=75993) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 08 22:41:54 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:41:54 user nova-compute[75993]: WARNING nova.virt.libvirt.driver [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 08 22:41:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Hypervisor/Node resource view: name=user free_ram=9211MB free_disk=24.922386169433594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}] {{(pid=75993) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75993) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG nova.compute.provider_tree [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed in ProviderTree for provider: 4677e2dc-e2f1-4c4a-b853-94006ef06d81 {{(pid=75993) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG nova.scheduler.client.report [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Inventory has not changed for provider 4677e2dc-e2f1-4c4a-b853-94006ef06d81 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75993) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG nova.compute.resource_tracker [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Compute_service record updated for user:user {{(pid=75993) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 08 22:41:54 user nova-compute[75993]: DEBUG oslo_concurrency.lockutils [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=75993) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 08 22:41:55 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:56 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:57 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:41:57 user nova-compute[75993]: DEBUG nova.compute.manager [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75993) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 08 22:41:57 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 08 22:42:00 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:42:02 user nova-compute[75993]: DEBUG oslo_service.periodic_task [None req-a2944bd9-27ab-473c-bcb8-46f4d7c1b7b8 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75993) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 08 22:42:02 user nova-compute[75993]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75993) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}